Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 originally caused by: Started by upstream project "master-osmo-pcu" build number 5354 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6681 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6676 originally caused by: Started by upstream project "master-libgtpnl" build number 1810 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5152 originally caused by: Started by upstream project "master-osmo-pcu" build number 5354 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 originally caused by: Started by upstream project "master-osmo-pcu" build number 5354 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30047 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37201 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30048 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37202 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6676 originally caused by: Started by upstream project "master-libgtpnl" build number 1810 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8947 originally caused by: Started by upstream project "master-osmo-mgw" build number 9179 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17660 originally caused by: Started by upstream project "master-osmo-bsc" build number 20115 originally caused by: Started by upstream project "master-osmo-mgw" build number 9179 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29270 originally caused by: Started by upstream project "master-osmo-msc" build number 34218 originally caused by: Started by upstream project "master-osmo-mgw" build number 9179 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17660 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8947 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2956 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29270 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30048 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12971 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9242 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins8174594172746305668.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 09:47:56 + trial_dir_prefix=trial- + rm -rf trial-2372 trial-2372-bin.tgz trial-2372-run.tgz + trial_dir=trial-2373 + mkdir -p trial-2373 + mv open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2956.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29270.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30048.tgz osmo-stp.build-9242.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2373 + cat open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2956.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29270.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30048.md5 osmo-stp.build-9242.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17660.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6681.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2956.md5 osmo-mgw.build-8947.md5 osmo-msc.build-29270.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30048.md5 osmo-stp.build-9242.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2373 combinations: None trial: 'trial-2373' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2373 -------------------------------------------------------------------------------------------- 09:48:07.497931 tst trial-2373: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/log --------------------------------------------------------------------- trial-2373 nitb_sms:sysmo --------------------------------------------------------------------- 09:50:16.915853 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:16.919572 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 09:50:16.943235 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 09:50:16.950803 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 09:50:17.007696 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 09:50:17.040909 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 09:50:17.053476 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 09:50:17.572173 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 09:50:17.577016 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 09:50:17.587670 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 09:50:17.959885 tst mo_mt_sms.py: using LAC 27557 09:50:18.193839 tst mo_mt_sms.py: using RAC 17 09:50:18.307972 tst mo_mt_sms.py: using CellId 27557 09:50:18.423343 tst mo_mt_sms.py: using BVCI 27558 09:50:18.527574 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 09:50:18.707163 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 09:50:18.822079 tst mo_mt_sms.py:9: start nitb and bts... 09:50:19.020143 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:50:21.234627 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25530): Launched 09:50:21.531223 run osmo-nitb_10.42.42.2(pid=25531): Launched 09:50:21.692764 run osmo-nitb_10.42.42.2(pid=25531): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25531)] 09:50:21.815446 run osmo-nitb_10.42.42.2(pid=25531): stdout: | (launched: 2022-12-10_09:50:21.476722) 09:50:21.939947 run osmo-nitb_10.42.42.2(pid=25531): stderr: | (launched: 2022-12-10_09:50:21.520891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:50:22.063830 run osmo-nitb_10.42.42.2(pid=25531): stdout: | (launched: 2022-12-10_09:50:21.476722) 09:50:22.182130 run osmo-nitb_10.42.42.2(pid=25531): stderr: | (launched: 2022-12-10_09:50:21.520891) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:50:22.323738 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25531): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25531) [trial-2373↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25531)] [trial-2373↪nitb_sms:sysmo↪mo_mt_sms.py:11] 09:50:22.331857 tst mo_mt_sms.py:11: Test FAILED (4.7 sec) 09:50:22.338262 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25530): Terminating (SIGTERM) 09:50:22.546868 --- ParallelTerminationStrategy: PID 25530 died... 09:50:22.567584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25530): Terminated: ok {rc=0} 09:50:22.653381 bus /sierra_3: Setting Powered False 09:50:23.754997 bus /sierra_3: Setting Powered False 09:50:24.871964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:sysmo --------------------------------------------------------------------- 09:50:26.058132 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:26.062380 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 09:50:26.084331 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 09:50:26.113288 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 09:50:26.166935 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 09:50:26.188026 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 09:50:26.215477 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 09:50:26.762856 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:sysmo mo_mt_sms.py ---------------------------------------------- 09:50:26.767858 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:50:26.778795 tst sms:sysmo: Using 1 x bts (candidates: 1) 09:50:26.815119 tst mo_mt_sms.py: using LAC 27558 09:50:26.940568 tst mo_mt_sms.py: using RAC 18 09:50:27.064225 tst mo_mt_sms.py: using CellId 27558 09:50:27.187762 tst mo_mt_sms.py: using BVCI 27559 09:50:27.301597 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:50:27.312469 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:50:27.323366 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:50:27.334363 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:50:27.345436 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 09:50:27.356313 tst sms:sysmo: Using 1 x modem (candidates: 2) 09:50:27.474924 tst sms:sysmo: Using 1 x modem (candidates: 2) 09:50:27.595569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:50:29.327684 run create_hlr_db(pid=25537): Launched 09:50:29.447507 bus /sierra_2: Setting Powered False 09:50:30.510823 run create_hlr_db(pid=25537): Terminated: ok {rc=0} 09:50:30.958636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25539): Launched 09:50:31.351306 run osmo-hlr_10.42.42.2(pid=25540): Launched 09:50:31.591533 run osmo-stp_10.42.42.5: Starting osmo-stp 09:50:34.112721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25542): Launched 09:50:34.405947 run osmo-stp_10.42.42.5(pid=25543): Launched 09:50:34.517410 run osmo-msc_10.42.42.6: Starting osmo-msc 09:50:39.725409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25545): Launched 09:50:40.019306 run osmo-msc_10.42.42.6(pid=25546): Launched 09:50:40.183194 run osmo-stp_10.42.42.5(pid=25543): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25543)] 09:50:40.306832 run osmo-stp_10.42.42.5(pid=25543): stdout: | (launched: 2022-12-10_09:50:34.353083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:40.432144 run osmo-stp_10.42.42.5(pid=25543): stderr: | 20221210095034521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095034521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095034522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095034522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095034523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095034523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095034523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:40.554594 run osmo-stp_10.42.42.5(pid=25543): stdout: | (launched: 2022-12-10_09:50:34.353083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:40.671406 run osmo-stp_10.42.42.5(pid=25543): stderr: | 20221210095034521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095034521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095034522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095034522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095034523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095034523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095034523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:40.811214 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25543): Process ended prematurely: osmo-stp_10.42.42.5(pid=25543) [trial-2373↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25543)] [trial-2373↪sms:sysmo↪mo_mt_sms.py:16] 09:50:40.819305 tst mo_mt_sms.py:16: Test FAILED (14.0 sec) 09:50:40.845061 run osmo-hlr_10.42.42.2(pid=25540): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25540)] 09:50:40.892756 run osmo-hlr_10.42.42.2(pid=25540): stdout: | (launched: 2022-12-10_09:50:31.279651) 09:50:40.942459 run osmo-hlr_10.42.42.2(pid=25540): stderr: | 20221210095031529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095031530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095031530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095031530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095031530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095031530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095031543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095031562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095031562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095031562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:50:41.011429 run osmo-msc_10.42.42.6(pid=25546): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25546)] 09:50:41.059267 run osmo-msc_10.42.42.6(pid=25546): stdout: | (launched: 2022-12-10_09:50:39.966075) 09:50:41.109319 run osmo-msc_10.42.42.6(pid=25546): stderr: | 20221210095040239 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095040239 DLGLOBAL DEBUG validating counter group 0x7f6aa8f00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095040239 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095040240 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095040240 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095040240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095040242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095040242 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095040242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095040242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:50:41.158971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25539): Terminating (SIGTERM) 09:50:41.198691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25542): Terminating (SIGTERM) 09:50:41.238340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25545): Terminating (SIGTERM) 09:50:41.278142 --- ParallelTerminationStrategy: PID 25539 died... 09:50:41.297132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25539): Terminated: ok {rc=0} 09:50:41.341027 --- ParallelTerminationStrategy: PID 25542 died... 09:50:41.359614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25542): Terminated: ok {rc=0} 09:50:41.403418 --- ParallelTerminationStrategy: PID 25545 died... 09:50:41.421887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25545): Terminated: ok {rc=0} 09:50:41.507827 bus /sierra_3: Setting Powered False 09:50:42.609973 bus /sierra_3: Setting Powered False 09:50:43.726018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:sysmo --------------------------------------------------------------------- 09:50:44.953059 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:44.957110 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 09:50:44.978858 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 09:50:44.986170 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 09:50:45.020364 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 09:50:45.043295 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 09:50:45.050485 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 09:50:45.570241 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 09:50:45.575622 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 09:50:45.586737 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 09:50:45.623787 tst assert_extension.py: using LAC 27559 09:50:45.746335 tst assert_extension.py: using RAC 19 09:50:45.881320 tst assert_extension.py: using CellId 27559 09:50:46.005984 tst assert_extension.py: using BVCI 27560 09:50:46.124676 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 09:50:46.239232 tst assert_extension.py:10: start nitb and bts... 09:50:46.486640 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:50:47.153302 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25551): Launched 09:50:47.478225 run osmo-nitb_10.42.42.2(pid=25552): Launched 09:50:47.654069 run osmo-nitb_10.42.42.2(pid=25552): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25552)] 09:50:47.796186 run osmo-nitb_10.42.42.2(pid=25552): stdout: | (launched: 2022-12-10_09:50:47.421627) 09:50:47.940115 run osmo-nitb_10.42.42.2(pid=25552): stderr: | (launched: 2022-12-10_09:50:47.468592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:50:48.084020 run osmo-nitb_10.42.42.2(pid=25552): stdout: | (launched: 2022-12-10_09:50:47.421627) 09:50:48.222489 run osmo-nitb_10.42.42.2(pid=25552): stderr: | (launched: 2022-12-10_09:50:47.468592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25552) [trial-2373↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25552)] 09:50:48.598583 tst osmo-nitb_10.42.42.2(pid=25552): stdout: | (launched: 2022-12-10_09:50:47.421627) 09:50:48.718020 tst osmo-nitb_10.42.42.2(pid=25552): stderr: | (launched: 2022-12-10_09:50:47.468592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:50:48.858390 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25552) [trial-2373↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25552)] [trial-2373↪nitb_ussd:sysmo↪assert_extension.py:12] 09:50:48.866793 tst assert_extension.py:12: Test FAILED (3.3 sec) 09:50:48.873509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25551): Terminating (SIGTERM) 09:50:49.082311 --- ParallelTerminationStrategy: PID 25551 died... 09:50:49.103326 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25551): Terminated: ok {rc=0} 09:50:49.187213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:sysmo --------------------------------------------------------------------- 09:50:50.373059 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:50.376591 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 09:50:50.397233 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 09:50:50.423601 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 09:50:50.459701 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 09:50:50.483149 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 09:50:50.512577 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 09:50:51.033577 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:sysmo assert_extension.py ---------------------------------------------- 09:50:51.038721 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:50:51.049493 tst ussd:sysmo: Using 1 x bts (candidates: 1) 09:50:51.084348 tst assert_extension.py: using LAC 27560 09:50:51.211613 tst assert_extension.py: using RAC 20 09:50:51.337760 tst assert_extension.py: using CellId 27560 09:50:51.464811 tst assert_extension.py: using BVCI 27561 09:50:51.580100 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:50:51.591396 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:50:51.602521 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:50:51.613689 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:50:51.624549 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 09:50:51.635475 tst ussd:sysmo: Using 1 x modem (candidates: 1) 09:50:51.748481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:50:52.207227 run create_hlr_db(pid=25572): Launched 09:50:52.328637 bus /sierra_2: Setting Powered False 09:50:53.388014 run create_hlr_db(pid=25572): Terminated: ok {rc=0} 09:50:53.821371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Launched 09:50:54.138704 run osmo-hlr_10.42.42.2(pid=25575): Launched 09:50:54.259765 run osmo-stp_10.42.42.5: Starting osmo-stp 09:50:54.804148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Launched 09:50:55.120803 run osmo-stp_10.42.42.5(pid=25578): Launched 09:50:55.241923 run osmo-msc_10.42.42.6: Starting osmo-msc 09:50:55.809176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Launched 09:50:56.123290 run osmo-msc_10.42.42.6(pid=25581): Launched 09:50:56.299857 run osmo-stp_10.42.42.5(pid=25578): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] 09:50:56.433817 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-10_09:50:55.062779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:56.568662 run osmo-stp_10.42.42.5(pid=25578): stderr: | 20221210095055254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095055255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095055255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095055255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095055256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095055256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095055256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:56.702625 run osmo-stp_10.42.42.5(pid=25578): stdout: | (launched: 2022-12-10_09:50:55.062779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:50:56.829186 run osmo-stp_10.42.42.5(pid=25578): stderr: | 20221210095055254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095055255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095055255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095055255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095055256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095055256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095055256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:50:56.980476 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2373↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] [trial-2373↪ussd:sysmo↪assert_extension.py:17] 09:50:56.989493 tst assert_extension.py:17: Test FAILED (5.9 sec) 09:50:57.017579 run osmo-hlr_10.42.42.2(pid=25575): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25575)] 09:50:57.068025 run osmo-hlr_10.42.42.2(pid=25575): stdout: | (launched: 2022-12-10_09:50:54.081389) 09:50:57.120522 run osmo-hlr_10.42.42.2(pid=25575): stderr: | 20221210095054280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095054280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095054280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095054280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095054280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095054280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095054406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095054415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095054415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095054415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:50:57.192881 run osmo-msc_10.42.42.6(pid=25581): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25581)] 09:50:57.243484 run osmo-msc_10.42.42.6(pid=25581): stdout: | (launched: 2022-12-10_09:50:56.066614) 09:50:57.295324 run osmo-msc_10.42.42.6(pid=25581): stderr: | 20221210095056385 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095056385 DLGLOBAL DEBUG validating counter group 0x7f904cab9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095056385 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095056385 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095056385 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095056385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095056387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095056387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095056388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095056388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:50:57.347861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminating (SIGTERM) 09:50:57.390230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminating (SIGTERM) 09:50:57.432579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Terminating (SIGTERM) 09:50:57.475800 --- ParallelTerminationStrategy: PID 25574 died... 09:50:57.496020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25574): Terminated: ok {rc=0} 09:50:57.543222 --- ParallelTerminationStrategy: PID 25577 died... 09:50:57.563071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25577): Terminated: ok {rc=0} 09:50:57.610088 --- ParallelTerminationStrategy: PID 25580 died... 09:50:57.629686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25580): Terminated: ok {rc=0} 09:50:57.717641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:50:58.918737 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:50:58.925526 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:50:58.947445 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:50:58.975243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:50:59.028143 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:50:59.049431 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:50:59.076844 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:50:59.628626 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:50:59.682010 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:50:59.693425 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:50:59.751587 tst mo_mt_call.py: using LAC 27561 09:50:59.879257 tst mo_mt_call.py: using RAC 21 09:51:00.004265 tst mo_mt_call.py: using CellId 27561 09:51:00.129434 tst mo_mt_call.py: using BVCI 27562 09:51:00.248231 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:00.259831 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:00.271212 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:00.282699 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:00.294450 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:00.306113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:51:00.424240 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:51:00.541450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:01.057331 run create_hlr_db(pid=25587): Launched 09:51:01.199109 bus /sierra_2: Setting Powered False 09:51:02.264809 run create_hlr_db(pid=25587): Terminated: ok {rc=0} 09:51:02.716362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25589): Launched 09:51:03.037849 run osmo-hlr_10.42.42.2(pid=25590): Launched 09:51:03.161765 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:03.717483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25592): Launched 09:51:04.038938 run osmo-stp_10.42.42.5(pid=25593): Launched 09:51:04.161315 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:04.743914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25595): Launched 09:51:05.064212 run osmo-msc_10.42.42.6(pid=25596): Launched 09:51:05.243938 run osmo-stp_10.42.42.5(pid=25593): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25593)] 09:51:05.379833 run osmo-stp_10.42.42.5(pid=25593): stdout: | (launched: 2022-12-10_09:51:03.981323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:05.516271 run osmo-stp_10.42.42.5(pid=25593): stderr: | 20221210095104171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095104171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095104172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095104172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095104174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095104174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095104175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:05.652488 run osmo-stp_10.42.42.5(pid=25593): stdout: | (launched: 2022-12-10_09:51:03.981323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:05.780122 run osmo-stp_10.42.42.5(pid=25593): stderr: | 20221210095104171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095104171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095104172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095104172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095104174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095104174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095104175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:05.933379 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25593): Process ended prematurely: osmo-stp_10.42.42.5(pid=25593) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25593)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:51:05.942657 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:51:05.970239 run osmo-hlr_10.42.42.2(pid=25590): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25590)] 09:51:06.021062 run osmo-hlr_10.42.42.2(pid=25590): stdout: | (launched: 2022-12-10_09:51:02.980203) 09:51:06.072761 run osmo-hlr_10.42.42.2(pid=25590): stderr: | 20221210095103176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095103176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095103176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095103176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095103176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095103176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095103190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095103198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095103198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095103198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:06.145097 run osmo-msc_10.42.42.6(pid=25596): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25596)] 09:51:06.195176 run osmo-msc_10.42.42.6(pid=25596): stdout: | (launched: 2022-12-10_09:51:05.006629) 09:51:06.246856 run osmo-msc_10.42.42.6(pid=25596): stderr: | 20221210095105328 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095105328 DLGLOBAL DEBUG validating counter group 0x7f7fac2bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095105328 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095105328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095105328 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095105328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095105330 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095105331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095105331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095105331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:06.299475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25589): Terminating (SIGTERM) 09:51:06.341287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25592): Terminating (SIGTERM) 09:51:06.383009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25595): Terminating (SIGTERM) 09:51:06.425163 --- ParallelTerminationStrategy: PID 25589 died... 09:51:06.444889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25589): Terminated: ok {rc=0} 09:51:06.491156 --- ParallelTerminationStrategy: PID 25592 died... 09:51:06.510588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25592): Terminated: ok {rc=0} 09:51:06.556819 --- ParallelTerminationStrategy: PID 25595 died... 09:51:06.576622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25595): Terminated: ok {rc=0} 09:51:06.663949 bus /sierra_3: Setting Powered False 09:51:07.763174 bus /sierra_3: Setting Powered False 09:51:08.879915 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:51:10.027355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:10.039037 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:51:10.095654 tst mo_mt_call_osmux.py: using LAC 27562 09:51:10.215914 tst mo_mt_call_osmux.py: using RAC 22 09:51:10.346647 tst mo_mt_call_osmux.py: using CellId 27562 09:51:10.476079 tst mo_mt_call_osmux.py: using BVCI 27563 09:51:10.594839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:10.606452 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:10.617822 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:10.629497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:10.641107 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:51:10.652560 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:51:10.767712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:51:10.886550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:11.386509 run create_hlr_db(pid=25598): Launched 09:51:11.508384 bus /sierra_2: Setting Powered False 09:51:12.572550 run create_hlr_db(pid=25598): Terminated: ok {rc=0} 09:51:13.003812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25600): Launched 09:51:13.304687 run osmo-hlr_10.42.42.2(pid=25601): Launched 09:51:13.419425 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:13.949304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25603): Launched 09:51:14.249876 run osmo-stp_10.42.42.5(pid=25604): Launched 09:51:14.365611 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:14.908341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25606): Launched 09:51:15.208399 run osmo-msc_10.42.42.6(pid=25607): Launched 09:51:15.376848 run osmo-stp_10.42.42.5(pid=25604): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25604)] 09:51:15.508549 run osmo-stp_10.42.42.5(pid=25604): stdout: | (launched: 2022-12-10_09:51:14.195406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:15.635707 run osmo-stp_10.42.42.5(pid=25604): stderr: | 20221210095114364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095114364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095114364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095114365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095114365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095114365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095114365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:15.761656 run osmo-stp_10.42.42.5(pid=25604): stdout: | (launched: 2022-12-10_09:51:14.195406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:15.912034 run osmo-stp_10.42.42.5(pid=25604): stderr: | 20221210095114364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095114364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095114364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095114365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095114365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095114365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095114365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:16.072199 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25604): Process ended prematurely: osmo-stp_10.42.42.5(pid=25604) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25604)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:51:16.082675 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:51:16.114240 run osmo-hlr_10.42.42.2(pid=25601): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25601)] 09:51:16.168011 run osmo-hlr_10.42.42.2(pid=25601): stdout: | (launched: 2022-12-10_09:51:13.250543) 09:51:16.223591 run osmo-hlr_10.42.42.2(pid=25601): stderr: | 20221210095113425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095113425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095113425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095113425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095113425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095113425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095113437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095113446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095113446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095113447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:16.299284 run osmo-msc_10.42.42.6(pid=25607): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25607)] 09:51:16.352093 run osmo-msc_10.42.42.6(pid=25607): stdout: | (launched: 2022-12-10_09:51:15.154258) 09:51:16.407583 run osmo-msc_10.42.42.6(pid=25607): stderr: | 20221210095115425 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095115425 DLGLOBAL DEBUG validating counter group 0x7f74d2ac1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095115425 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095115425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095115425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095115426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095115428 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095115429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095115429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095115429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:16.462683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25600): Terminating (SIGTERM) 09:51:16.507987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25603): Terminating (SIGTERM) 09:51:16.556650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25606): Terminating (SIGTERM) 09:51:16.606363 --- ParallelTerminationStrategy: PID 25600 died... 09:51:16.626499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25600): Terminated: ok {rc=0} 09:51:16.678493 --- ParallelTerminationStrategy: PID 25603 died... 09:51:16.699658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25603): Terminated: ok {rc=0} 09:51:16.750304 --- ParallelTerminationStrategy: PID 25606 died... 09:51:16.771140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25606): Terminated: ok {rc=0} 09:51:16.865776 bus /sierra_3: Setting Powered False 09:51:17.967517 bus /sierra_3: Setting Powered False 09:51:19.085396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:51:20.322838 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:20.329667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:51:20.351520 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:51:20.379332 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:51:20.432533 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:51:20.453792 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:51:20.481411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:51:21.037361 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:51:21.089042 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:21.100386 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:51:21.158360 tst mo_mt_call.py: using LAC 27563 09:51:21.284416 tst mo_mt_call.py: using RAC 23 09:51:21.410294 tst mo_mt_call.py: using CellId 27563 09:51:21.537723 tst mo_mt_call.py: using BVCI 27564 09:51:21.648939 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:21.659981 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:21.670903 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:21.681796 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:21.692387 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:21.703061 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:51:21.818910 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:51:21.932574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:22.396366 run create_hlr_db(pid=25612): Launched 09:51:22.519696 bus /sierra_2: Setting Powered False 09:51:23.580476 run create_hlr_db(pid=25612): Terminated: ok {rc=0} 09:51:24.020338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25614): Launched 09:51:24.342020 run osmo-hlr_10.42.42.2(pid=25615): Launched 09:51:24.465225 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:25.021173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25617): Launched 09:51:25.343145 run osmo-stp_10.42.42.5(pid=25618): Launched 09:51:25.465986 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:26.047268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25620): Launched 09:51:26.368703 run osmo-msc_10.42.42.6(pid=25621): Launched 09:51:26.548217 run osmo-stp_10.42.42.5(pid=25618): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25618)] 09:51:26.684919 run osmo-stp_10.42.42.5(pid=25618): stdout: | (launched: 2022-12-10_09:51:25.285661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:26.821816 run osmo-stp_10.42.42.5(pid=25618): stderr: | 20221210095125478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095125478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095125478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095125479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095125479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095125479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095125479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:26.958299 run osmo-stp_10.42.42.5(pid=25618): stdout: | (launched: 2022-12-10_09:51:25.285661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:27.086717 run osmo-stp_10.42.42.5(pid=25618): stderr: | 20221210095125478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095125478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095125478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095125479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095125479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095125479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095125479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:27.240756 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25618): Process ended prematurely: osmo-stp_10.42.42.5(pid=25618) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25618)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:51:27.250487 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:51:27.278835 run osmo-hlr_10.42.42.2(pid=25615): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25615)] 09:51:27.329070 run osmo-hlr_10.42.42.2(pid=25615): stdout: | (launched: 2022-12-10_09:51:24.284397) 09:51:27.381092 run osmo-hlr_10.42.42.2(pid=25615): stderr: | 20221210095124484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095124484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095124484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095124484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095124484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095124484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095124496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095124505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095124505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095124505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:27.453282 run osmo-msc_10.42.42.6(pid=25621): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25621)] 09:51:27.503434 run osmo-msc_10.42.42.6(pid=25621): stdout: | (launched: 2022-12-10_09:51:26.311138) 09:51:27.554968 run osmo-msc_10.42.42.6(pid=25621): stderr: | 20221210095126631 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095126631 DLGLOBAL DEBUG validating counter group 0x7f3ea5525c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095126631 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095126631 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095126631 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095126632 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095126633 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095126634 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095126634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095126634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:27.606996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25614): Terminating (SIGTERM) 09:51:27.648828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25617): Terminating (SIGTERM) 09:51:27.690717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25620): Terminating (SIGTERM) 09:51:27.732486 --- ParallelTerminationStrategy: PID 25614 died... 09:51:27.752300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25614): Terminated: ok {rc=0} 09:51:27.798689 --- ParallelTerminationStrategy: PID 25617 died... 09:51:27.818009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25617): Terminated: ok {rc=0} 09:51:27.864407 --- ParallelTerminationStrategy: PID 25620 died... 09:51:27.883808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25620): Terminated: ok {rc=0} 09:51:27.971895 bus /sierra_3: Setting Powered False 09:51:29.070323 bus /sierra_3: Setting Powered False 09:51:30.186310 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:51:31.331657 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:31.344023 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:51:31.405277 tst mo_mt_call_osmux.py: using LAC 27564 09:51:31.561316 tst mo_mt_call_osmux.py: using RAC 24 09:51:31.686678 tst mo_mt_call_osmux.py: using CellId 27564 09:51:31.846337 tst mo_mt_call_osmux.py: using BVCI 27565 09:51:31.958617 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:31.970883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:31.983757 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:31.996156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:32.008543 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:51:32.020584 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:51:32.149375 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:51:32.294482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:32.794820 run create_hlr_db(pid=25623): Launched 09:51:32.917904 bus /sierra_2: Setting Powered False 09:51:33.982150 run create_hlr_db(pid=25623): Terminated: ok {rc=0} 09:51:34.413077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Launched 09:51:34.714355 run osmo-hlr_10.42.42.2(pid=25626): Launched 09:51:34.827640 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:35.358118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Launched 09:51:35.657272 run osmo-stp_10.42.42.5(pid=25629): Launched 09:51:35.770998 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:36.315157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25631): Launched 09:51:36.616656 run osmo-msc_10.42.42.6(pid=25632): Launched 09:51:36.783485 run osmo-stp_10.42.42.5(pid=25629): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] 09:51:36.910200 run osmo-stp_10.42.42.5(pid=25629): stdout: | (launched: 2022-12-10_09:51:35.603055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:37.037419 run osmo-stp_10.42.42.5(pid=25629): stderr: | 20221210095135772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095135772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095135772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095135773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095135775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095135775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095135775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:37.162832 run osmo-stp_10.42.42.5(pid=25629): stdout: | (launched: 2022-12-10_09:51:35.603055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:37.282271 run osmo-stp_10.42.42.5(pid=25629): stderr: | 20221210095135772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095135772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095135772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095135773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095135775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095135775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095135775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:37.425364 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25629): Process ended prematurely: osmo-stp_10.42.42.5(pid=25629) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:51:37.433989 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:51:37.460085 run osmo-hlr_10.42.42.2(pid=25626): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25626)] 09:51:37.507842 run osmo-hlr_10.42.42.2(pid=25626): stdout: | (launched: 2022-12-10_09:51:34.660041) 09:51:37.557168 run osmo-hlr_10.42.42.2(pid=25626): stderr: | 20221210095134834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095134834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095134834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095134834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095134835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095134835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095134847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095134858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095134859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095134859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:37.626232 run osmo-msc_10.42.42.6(pid=25632): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25632)] 09:51:37.674042 run osmo-msc_10.42.42.6(pid=25632): stdout: | (launched: 2022-12-10_09:51:36.561975) 09:51:37.723353 run osmo-msc_10.42.42.6(pid=25632): stderr: | 20221210095136836 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095136836 DLGLOBAL DEBUG validating counter group 0x7fb9dfc13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095136836 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095136836 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095136837 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095136837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095136838 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095136839 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095136839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095136839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:37.773086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Terminating (SIGTERM) 09:51:37.813026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Terminating (SIGTERM) 09:51:37.852763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25631): Terminating (SIGTERM) 09:51:37.892760 --- ParallelTerminationStrategy: PID 25625 died... 09:51:37.911819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25625): Terminated: ok {rc=0} 09:51:37.956396 --- ParallelTerminationStrategy: PID 25628 died... 09:51:37.975101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25628): Terminated: ok {rc=0} 09:51:38.018935 --- ParallelTerminationStrategy: PID 25631 died... 09:51:38.037439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25631): Terminated: ok {rc=0} 09:51:38.121625 bus /sierra_3: Setting Powered False 09:51:39.219278 bus /sierra_3: Setting Powered False 09:51:40.334470 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:51:41.563384 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:51:41.569510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:51:41.590153 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:51:41.616853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:51:41.668584 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:51:41.689360 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:51:41.715876 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:51:42.266851 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:51:42.314896 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:42.325814 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:51:42.380849 tst mo_mt_call.py: using LAC 27565 09:51:42.498638 tst mo_mt_call.py: using RAC 25 09:51:42.619090 tst mo_mt_call.py: using CellId 27565 09:51:42.741642 tst mo_mt_call.py: using BVCI 27566 09:51:42.851734 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:42.862854 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:42.873681 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:42.884464 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:42.895341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:42.906236 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:51:43.025353 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:51:43.140486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:43.607087 run create_hlr_db(pid=25637): Launched 09:51:43.734965 bus /sierra_2: Setting Powered False 09:51:44.798344 run create_hlr_db(pid=25637): Terminated: ok {rc=0} 09:51:45.229757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25639): Launched 09:51:45.529342 run osmo-hlr_10.42.42.2(pid=25640): Launched 09:51:45.643902 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:46.218828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25642): Launched 09:51:46.565420 run osmo-stp_10.42.42.5(pid=25643): Launched 09:51:46.821462 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:47.482576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25645): Launched 09:51:47.803440 run osmo-msc_10.42.42.6(pid=25646): Launched 09:51:47.982878 run osmo-stp_10.42.42.5(pid=25643): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25643)] 09:51:48.119098 run osmo-stp_10.42.42.5(pid=25643): stdout: | (launched: 2022-12-10_09:51:46.499738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:48.256793 run osmo-stp_10.42.42.5(pid=25643): stderr: | 20221210095146809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095146809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095146809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095146810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095146810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095146810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095146810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:48.392839 run osmo-stp_10.42.42.5(pid=25643): stdout: | (launched: 2022-12-10_09:51:46.499738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:48.521157 run osmo-stp_10.42.42.5(pid=25643): stderr: | 20221210095146809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095146809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095146809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095146810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095146810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095146810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095146810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:48.675282 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25643): Process ended prematurely: osmo-stp_10.42.42.5(pid=25643) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25643)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:51:48.684411 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:51:48.712523 run osmo-hlr_10.42.42.2(pid=25640): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25640)] 09:51:48.762810 run osmo-hlr_10.42.42.2(pid=25640): stdout: | (launched: 2022-12-10_09:51:45.475166) 09:51:48.814770 run osmo-hlr_10.42.42.2(pid=25640): stderr: | 20221210095145650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095145650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095145650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095145650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095145650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095145651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095145663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095145674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095145674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095145674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:48.886784 run osmo-msc_10.42.42.6(pid=25646): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25646)] 09:51:48.936853 run osmo-msc_10.42.42.6(pid=25646): stdout: | (launched: 2022-12-10_09:51:47.745906) 09:51:48.988418 run osmo-msc_10.42.42.6(pid=25646): stderr: | 20221210095148067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095148067 DLGLOBAL DEBUG validating counter group 0x7ff08c0eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095148067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095148067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095148067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095148067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095148069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095148069 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095148070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095148070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:49.040555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25639): Terminating (SIGTERM) 09:51:49.082303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25642): Terminating (SIGTERM) 09:51:49.124066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25645): Terminating (SIGTERM) 09:51:49.166540 --- ParallelTerminationStrategy: PID 25639 died... 09:51:49.186445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25639): Terminated: ok {rc=0} 09:51:49.232707 --- ParallelTerminationStrategy: PID 25642 died... 09:51:49.251985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25642): Terminated: ok {rc=0} 09:51:49.298485 --- ParallelTerminationStrategy: PID 25645 died... 09:51:49.317960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25645): Terminated: ok {rc=0} 09:51:49.405591 bus /sierra_3: Setting Powered False 09:51:50.501189 bus /sierra_3: Setting Powered False 09:51:51.615761 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:51:52.766899 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:52.778941 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:51:52.837385 tst mo_mt_call_osmux.py: using LAC 27566 09:51:52.964459 tst mo_mt_call_osmux.py: using RAC 26 09:51:53.091279 tst mo_mt_call_osmux.py: using CellId 27566 09:51:53.219840 tst mo_mt_call_osmux.py: using BVCI 27567 09:51:53.337616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:53.349110 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:53.360453 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:53.372018 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:53.383483 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:51:53.395092 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:51:53.513692 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:51:53.635718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:51:54.136259 run create_hlr_db(pid=25648): Launched 09:51:54.258718 bus /sierra_2: Setting Powered False 09:51:55.322532 run create_hlr_db(pid=25648): Terminated: ok {rc=0} 09:51:55.770291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25650): Launched 09:51:56.091569 run osmo-hlr_10.42.42.2(pid=25651): Launched 09:51:56.215297 run osmo-stp_10.42.42.5: Starting osmo-stp 09:51:56.773629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25653): Launched 09:51:57.096085 run osmo-stp_10.42.42.5(pid=25654): Launched 09:51:57.219444 run osmo-msc_10.42.42.6: Starting osmo-msc 09:51:57.800820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25656): Launched 09:51:58.122486 run osmo-msc_10.42.42.6(pid=25657): Launched 09:51:58.302604 run osmo-stp_10.42.42.5(pid=25654): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25654)] 09:51:58.438602 run osmo-stp_10.42.42.5(pid=25654): stdout: | (launched: 2022-12-10_09:51:57.038123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:58.575594 run osmo-stp_10.42.42.5(pid=25654): stderr: | 20221210095157232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095157232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095157232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095157233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095157233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095157233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095157233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:58.711993 run osmo-stp_10.42.42.5(pid=25654): stdout: | (launched: 2022-12-10_09:51:57.038123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:51:58.840756 run osmo-stp_10.42.42.5(pid=25654): stderr: | 20221210095157232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095157232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095157232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095157233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095157233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095157233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095157233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:51:58.994037 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25654): Process ended prematurely: osmo-stp_10.42.42.5(pid=25654) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25654)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:51:59.003425 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:51:59.030965 run osmo-hlr_10.42.42.2(pid=25651): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25651)] 09:51:59.081337 run osmo-hlr_10.42.42.2(pid=25651): stdout: | (launched: 2022-12-10_09:51:56.033677) 09:51:59.133512 run osmo-hlr_10.42.42.2(pid=25651): stderr: | 20221210095156232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095156232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095156232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095156232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095156232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095156232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095156247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095156255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095156255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095156255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:51:59.205671 run osmo-msc_10.42.42.6(pid=25657): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25657)] 09:51:59.255724 run osmo-msc_10.42.42.6(pid=25657): stdout: | (launched: 2022-12-10_09:51:58.064470) 09:51:59.307533 run osmo-msc_10.42.42.6(pid=25657): stderr: | 20221210095158386 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095158386 DLGLOBAL DEBUG validating counter group 0x7f7b2c674c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095158386 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095158386 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095158387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095158387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095158390 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095158391 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095158391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095158391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:51:59.359764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25650): Terminating (SIGTERM) 09:51:59.401740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25653): Terminating (SIGTERM) 09:51:59.443558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25656): Terminating (SIGTERM) 09:51:59.485634 --- ParallelTerminationStrategy: PID 25650 died... 09:51:59.505559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25650): Terminated: ok {rc=0} 09:51:59.551853 --- ParallelTerminationStrategy: PID 25653 died... 09:51:59.571168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25653): Terminated: ok {rc=0} 09:51:59.617822 --- ParallelTerminationStrategy: PID 25656 died... 09:51:59.637222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25656): Terminated: ok {rc=0} 09:51:59.724308 bus /sierra_3: Setting Powered False 09:52:00.821304 bus /sierra_3: Setting Powered False 09:52:01.952795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:52:03.212405 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:03.221478 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:52:03.243629 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:52:03.271151 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:52:03.323593 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:52:03.345112 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:52:03.373241 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:52:03.924606 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:52:03.976647 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:03.988190 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:52:04.048750 tst mo_mt_call.py: using LAC 27567 09:52:04.175095 tst mo_mt_call.py: using RAC 27 09:52:04.292654 tst mo_mt_call.py: using CellId 27567 09:52:04.408659 tst mo_mt_call.py: using BVCI 27568 09:52:04.518148 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:04.529172 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:04.539869 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:04.550623 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:04.561444 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:04.572109 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:52:04.689737 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:52:04.809250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:05.307981 run create_hlr_db(pid=25662): Launched 09:52:05.431894 bus /sierra_2: Setting Powered False 09:52:06.495042 run create_hlr_db(pid=25662): Terminated: ok {rc=0} 09:52:06.927005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25664): Launched 09:52:07.228327 run osmo-hlr_10.42.42.2(pid=25665): Launched 09:52:07.342705 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:07.860144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25667): Launched 09:52:08.161073 run osmo-stp_10.42.42.5(pid=25668): Launched 09:52:08.275352 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:08.820898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25670): Launched 09:52:09.121632 run osmo-msc_10.42.42.6(pid=25671): Launched 09:52:09.289540 run osmo-stp_10.42.42.5(pid=25668): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25668)] 09:52:09.416524 run osmo-stp_10.42.42.5(pid=25668): stdout: | (launched: 2022-12-10_09:52:08.106559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:09.543906 run osmo-stp_10.42.42.5(pid=25668): stderr: | 20221210095208276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095208276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095208276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095208277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095208277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095208277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095208277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:09.669580 run osmo-stp_10.42.42.5(pid=25668): stdout: | (launched: 2022-12-10_09:52:08.106559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:09.789246 run osmo-stp_10.42.42.5(pid=25668): stderr: | 20221210095208276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095208276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095208276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095208277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095208277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095208277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095208277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:09.932259 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25668): Process ended prematurely: osmo-stp_10.42.42.5(pid=25668) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25668)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:52:09.940895 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:52:09.967009 run osmo-hlr_10.42.42.2(pid=25665): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25665)] 09:52:10.014606 run osmo-hlr_10.42.42.2(pid=25665): stdout: | (launched: 2022-12-10_09:52:07.173894) 09:52:10.064044 run osmo-hlr_10.42.42.2(pid=25665): stderr: | 20221210095207349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095207349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095207350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095207350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095207350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095207350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095207362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095207372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095207372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095207372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:10.132398 run osmo-msc_10.42.42.6(pid=25671): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25671)] 09:52:10.179953 run osmo-msc_10.42.42.6(pid=25671): stdout: | (launched: 2022-12-10_09:52:09.067316) 09:52:10.228814 run osmo-msc_10.42.42.6(pid=25671): stderr: | 20221210095209337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095209337 DLGLOBAL DEBUG validating counter group 0x7fe0ae8fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095209338 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095209338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095209338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095209338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095209341 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095209341 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095209341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095209341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:10.278225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25664): Terminating (SIGTERM) 09:52:10.317735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25667): Terminating (SIGTERM) 09:52:10.357435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25670): Terminating (SIGTERM) 09:52:10.397261 --- ParallelTerminationStrategy: PID 25664 died... 09:52:10.416101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25664): Terminated: ok {rc=0} 09:52:10.460053 --- ParallelTerminationStrategy: PID 25667 died... 09:52:10.478524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25667): Terminated: ok {rc=0} 09:52:10.522214 --- ParallelTerminationStrategy: PID 25670 died... 09:52:10.540668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25670): Terminated: ok {rc=0} 09:52:10.626705 bus /sierra_3: Setting Powered False 09:52:11.726423 bus /sierra_3: Setting Powered False 09:52:12.839692 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:52:13.985348 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:13.996813 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:52:14.053425 tst mo_mt_call_osmux.py: using LAC 27568 09:52:14.173630 tst mo_mt_call_osmux.py: using RAC 28 09:52:14.292690 tst mo_mt_call_osmux.py: using CellId 27568 09:52:14.411894 tst mo_mt_call_osmux.py: using BVCI 27569 09:52:14.523354 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:14.534348 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:14.545123 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:14.555796 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:14.566644 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:52:14.577449 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:52:14.691245 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:52:14.811021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:15.277898 run create_hlr_db(pid=25673): Launched 09:52:15.401388 bus /sierra_2: Setting Powered False 09:52:16.477799 run create_hlr_db(pid=25673): Terminated: ok {rc=0} 09:52:17.030608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Launched 09:52:17.340535 run osmo-hlr_10.42.42.2(pid=25676): Launched 09:52:17.455929 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:17.990694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Launched 09:52:18.290369 run osmo-stp_10.42.42.5(pid=25679): Launched 09:52:18.403934 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:18.947851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25681): Launched 09:52:19.248380 run osmo-msc_10.42.42.6(pid=25682): Launched 09:52:19.416707 run osmo-stp_10.42.42.5(pid=25679): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] 09:52:19.543990 run osmo-stp_10.42.42.5(pid=25679): stdout: | (launched: 2022-12-10_09:52:18.236179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:19.671430 run osmo-stp_10.42.42.5(pid=25679): stderr: | 20221210095218405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095218405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095218406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095218406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095218408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095218408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095218408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:19.796846 run osmo-stp_10.42.42.5(pid=25679): stdout: | (launched: 2022-12-10_09:52:18.236179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:19.916193 run osmo-stp_10.42.42.5(pid=25679): stderr: | 20221210095218405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095218405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095218406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095218406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095218408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095218408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095218408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:20.059078 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25679): Process ended prematurely: osmo-stp_10.42.42.5(pid=25679) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:52:20.067777 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:52:20.093819 run osmo-hlr_10.42.42.2(pid=25676): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25676)] 09:52:20.141539 run osmo-hlr_10.42.42.2(pid=25676): stdout: | (launched: 2022-12-10_09:52:17.285897) 09:52:20.190727 run osmo-hlr_10.42.42.2(pid=25676): stderr: | 20221210095217460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095217460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095217460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095217460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095217460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095217460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095217473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095217482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095217482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095217482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:20.259476 run osmo-msc_10.42.42.6(pid=25682): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25682)] 09:52:20.307578 run osmo-msc_10.42.42.6(pid=25682): stdout: | (launched: 2022-12-10_09:52:19.193909) 09:52:20.356719 run osmo-msc_10.42.42.6(pid=25682): stderr: | 20221210095219464 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095219464 DLGLOBAL DEBUG validating counter group 0x7f7c4da3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095219464 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095219464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095219465 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095219465 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095219466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095219468 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095219468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095219468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:20.405964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Terminating (SIGTERM) 09:52:20.445307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Terminating (SIGTERM) 09:52:20.484907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25681): Terminating (SIGTERM) 09:52:20.524436 --- ParallelTerminationStrategy: PID 25675 died... 09:52:20.543445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25675): Terminated: ok {rc=0} 09:52:20.586971 --- ParallelTerminationStrategy: PID 25678 died... 09:52:20.605421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25678): Terminated: ok {rc=0} 09:52:20.649402 --- ParallelTerminationStrategy: PID 25681 died... 09:52:20.667783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25681): Terminated: ok {rc=0} 09:52:20.753331 bus /sierra_3: Setting Powered False 09:52:21.850777 bus /sierra_3: Setting Powered False 09:52:22.965619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:52:24.198679 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:24.204722 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:52:24.225345 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:52:24.251736 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:52:24.302613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:52:24.323125 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:52:24.349256 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:52:24.900564 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:52:24.948458 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:24.959590 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:52:25.016040 tst mo_mt_call.py: using LAC 27569 09:52:25.135601 tst mo_mt_call.py: using RAC 29 09:52:25.254820 tst mo_mt_call.py: using CellId 27569 09:52:25.374206 tst mo_mt_call.py: using BVCI 27570 09:52:25.484372 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:25.495469 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:25.506324 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:25.517099 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:25.527924 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:25.538753 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:52:25.655049 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:52:25.772456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:26.236930 run create_hlr_db(pid=25687): Launched 09:52:26.359925 bus /sierra_2: Setting Powered False 09:52:27.420267 run create_hlr_db(pid=25687): Terminated: ok {rc=0} 09:52:27.839096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25689): Launched 09:52:28.138675 run osmo-hlr_10.42.42.2(pid=25690): Launched 09:52:28.251934 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:28.786376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25692): Launched 09:52:29.087051 run osmo-stp_10.42.42.5(pid=25693): Launched 09:52:29.200610 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:29.744307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25695): Launched 09:52:30.045521 run osmo-msc_10.42.42.6(pid=25696): Launched 09:52:30.213958 run osmo-stp_10.42.42.5(pid=25693): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25693)] 09:52:30.342239 run osmo-stp_10.42.42.5(pid=25693): stdout: | (launched: 2022-12-10_09:52:29.032707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:30.470159 run osmo-stp_10.42.42.5(pid=25693): stderr: | 20221210095229205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095229205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095229206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095229206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095229207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095229207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095229207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:30.596049 run osmo-stp_10.42.42.5(pid=25693): stdout: | (launched: 2022-12-10_09:52:29.032707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:30.715685 run osmo-stp_10.42.42.5(pid=25693): stderr: | 20221210095229205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095229205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095229206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095229206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095229207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095229207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095229207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:30.859950 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25693): Process ended prematurely: osmo-stp_10.42.42.5(pid=25693) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25693)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:52:30.869072 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 09:52:30.895487 run osmo-hlr_10.42.42.2(pid=25690): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25690)] 09:52:30.944147 run osmo-hlr_10.42.42.2(pid=25690): stdout: | (launched: 2022-12-10_09:52:28.084374) 09:52:30.993688 run osmo-hlr_10.42.42.2(pid=25690): stderr: | 20221210095228262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095228262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095228262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095228262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095228262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095228262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095228275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095228283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095228283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095228283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:31.062880 run osmo-msc_10.42.42.6(pid=25696): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25696)] 09:52:31.111872 run osmo-msc_10.42.42.6(pid=25696): stdout: | (launched: 2022-12-10_09:52:29.990885) 09:52:31.162328 run osmo-msc_10.42.42.6(pid=25696): stderr: | 20221210095230262 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095230262 DLGLOBAL DEBUG validating counter group 0x7fc7584fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095230262 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095230262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095230262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095230263 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095230264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095230266 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095230266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095230266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:31.213297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25689): Terminating (SIGTERM) 09:52:31.254004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25692): Terminating (SIGTERM) 09:52:31.296016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25695): Terminating (SIGTERM) 09:52:31.336598 --- ParallelTerminationStrategy: PID 25689 died... 09:52:31.355621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25689): Terminated: ok {rc=0} 09:52:31.400212 --- ParallelTerminationStrategy: PID 25692 died... 09:52:31.419421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25692): Terminated: ok {rc=0} 09:52:31.464094 --- ParallelTerminationStrategy: PID 25695 died... 09:52:31.483095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25695): Terminated: ok {rc=0} 09:52:31.570391 bus /sierra_3: Setting Powered False 09:52:32.673028 bus /sierra_3: Setting Powered False 09:52:33.790008 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:52:34.940269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:34.952577 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:52:35.011115 tst mo_mt_call_osmux.py: using LAC 27570 09:52:35.138165 tst mo_mt_call_osmux.py: using RAC 30 09:52:35.265198 tst mo_mt_call_osmux.py: using CellId 27570 09:52:35.391058 tst mo_mt_call_osmux.py: using BVCI 27571 09:52:35.508025 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:35.519605 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:35.530932 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:35.542456 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:35.553968 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:52:35.565940 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:52:35.683029 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:52:35.805476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:36.310457 run create_hlr_db(pid=25699): Launched 09:52:36.434533 bus /sierra_2: Setting Powered False 09:52:37.498135 run create_hlr_db(pid=25699): Terminated: ok {rc=0} 09:52:37.930160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25701): Launched 09:52:38.231326 run osmo-hlr_10.42.42.2(pid=25702): Launched 09:52:38.345741 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:38.869429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25704): Launched 09:52:39.171693 run osmo-stp_10.42.42.5(pid=25705): Launched 09:52:39.285722 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:39.829733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25707): Launched 09:52:40.131714 run osmo-msc_10.42.42.6(pid=25708): Launched 09:52:40.300029 run osmo-stp_10.42.42.5(pid=25705): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25705)] 09:52:40.427952 run osmo-stp_10.42.42.5(pid=25705): stdout: | (launched: 2022-12-10_09:52:39.116752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:40.555562 run osmo-stp_10.42.42.5(pid=25705): stderr: | 20221210095239287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095239287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095239287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095239288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095239288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095239288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095239288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:40.681447 run osmo-stp_10.42.42.5(pid=25705): stdout: | (launched: 2022-12-10_09:52:39.116752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:40.801728 run osmo-stp_10.42.42.5(pid=25705): stderr: | 20221210095239287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095239287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095239287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095239288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095239288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095239288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095239288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:40.945606 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25705): Process ended prematurely: osmo-stp_10.42.42.5(pid=25705) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25705)] [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:52:40.954387 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:52:40.980580 run osmo-hlr_10.42.42.2(pid=25702): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25702)] 09:52:41.028700 run osmo-hlr_10.42.42.2(pid=25702): stdout: | (launched: 2022-12-10_09:52:38.177101) 09:52:41.077628 run osmo-hlr_10.42.42.2(pid=25702): stderr: | 20221210095238354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095238354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095238354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095238354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095238354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095238354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095238365 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095238374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095238374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095238374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:41.145759 run osmo-msc_10.42.42.6(pid=25708): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25708)] 09:52:41.192931 run osmo-msc_10.42.42.6(pid=25708): stdout: | (launched: 2022-12-10_09:52:40.077320) 09:52:41.241675 run osmo-msc_10.42.42.6(pid=25708): stderr: | 20221210095240349 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095240349 DLGLOBAL DEBUG validating counter group 0x7f7144993c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095240349 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095240349 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095240349 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095240350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095240352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095240353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095240353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095240353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:41.290721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25701): Terminating (SIGTERM) 09:52:41.329835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25704): Terminating (SIGTERM) 09:52:41.369231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25707): Terminating (SIGTERM) 09:52:41.408489 --- ParallelTerminationStrategy: PID 25701 died... 09:52:41.427284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25701): Terminated: ok {rc=0} 09:52:41.470947 --- ParallelTerminationStrategy: PID 25704 died... 09:52:41.489531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25704): Terminated: ok {rc=0} 09:52:41.533050 --- ParallelTerminationStrategy: PID 25707 died... 09:52:41.551291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25707): Terminated: ok {rc=0} 09:52:41.636889 bus /sierra_3: Setting Powered False 09:52:42.735851 bus /sierra_3: Setting Powered False 09:52:43.850932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:52:45.083213 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:52:45.089404 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:52:45.110310 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:52:45.137270 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:52:45.190299 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:52:45.211632 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:52:45.238311 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:52:45.786606 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:52:45.840321 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:45.865286 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:52:45.923634 tst mo_mt_call.py: using LAC 27571 09:52:46.050224 tst mo_mt_call.py: using RAC 31 09:52:46.206639 tst mo_mt_call.py: using CellId 27571 09:52:46.367118 tst mo_mt_call.py: using BVCI 27572 09:52:46.483119 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:46.498165 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:46.513947 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:46.532078 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:46.549058 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:46.566366 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:52:46.686120 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:52:46.810465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:47.303038 run create_hlr_db(pid=25713): Launched 09:52:47.443467 bus /sierra_2: Setting Powered False 09:52:48.503904 run create_hlr_db(pid=25713): Terminated: ok {rc=0} 09:52:48.946342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25715): Launched 09:52:49.269809 run osmo-hlr_10.42.42.2(pid=25716): Launched 09:52:49.394159 run osmo-stp_10.42.42.5: Starting osmo-stp 09:52:49.954860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25718): Launched 09:52:50.278897 run osmo-stp_10.42.42.5(pid=25719): Launched 09:52:50.403030 run osmo-msc_10.42.42.6: Starting osmo-msc 09:52:50.988433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25721): Launched 09:52:51.312660 run osmo-msc_10.42.42.6(pid=25722): Launched 09:52:51.493280 run osmo-stp_10.42.42.5(pid=25719): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25719)] 09:52:51.630508 run osmo-stp_10.42.42.5(pid=25719): stdout: | (launched: 2022-12-10_09:52:50.220937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:51.768733 run osmo-stp_10.42.42.5(pid=25719): stderr: | 20221210095250415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095250415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095250415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095250416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095250416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095250416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095250416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:51.905829 run osmo-stp_10.42.42.5(pid=25719): stdout: | (launched: 2022-12-10_09:52:50.220937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:52:52.034791 run osmo-stp_10.42.42.5(pid=25719): stderr: | 20221210095250415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095250415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095250415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095250416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095250416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095250416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095250416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:52:52.189635 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25719): Process ended prematurely: osmo-stp_10.42.42.5(pid=25719) [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25719)] [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:52:52.199059 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:52:52.227381 run osmo-hlr_10.42.42.2(pid=25716): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25716)] 09:52:52.277825 run osmo-hlr_10.42.42.2(pid=25716): stdout: | (launched: 2022-12-10_09:52:49.212131) 09:52:52.330068 run osmo-hlr_10.42.42.2(pid=25716): stderr: | 20221210095249411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095249411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095249411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095249411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095249411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095249411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095249423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095249432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095249432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095249432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:52:52.402899 run osmo-msc_10.42.42.6(pid=25722): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25722)] 09:52:52.453368 run osmo-msc_10.42.42.6(pid=25722): stdout: | (launched: 2022-12-10_09:52:51.254899) 09:52:52.505467 run osmo-msc_10.42.42.6(pid=25722): stderr: | 20221210095251575 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095251575 DLGLOBAL DEBUG validating counter group 0x7ff34b318c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095251575 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095251575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095251575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095251576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095251578 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095251578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095251578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095251578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:52:52.557811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25715): Terminating (SIGTERM) 09:52:52.599958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25718): Terminating (SIGTERM) 09:52:52.642365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25721): Terminating (SIGTERM) 09:52:52.684802 --- ParallelTerminationStrategy: PID 25715 died... 09:52:52.704859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25715): Terminated: ok {rc=0} 09:52:52.751803 --- ParallelTerminationStrategy: PID 25718 died... 09:52:52.771362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25718): Terminated: ok {rc=0} 09:52:52.818220 --- ParallelTerminationStrategy: PID 25721 died... 09:52:52.837782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25721): Terminated: ok {rc=0} 09:52:52.926658 bus /sierra_3: Setting Powered False 09:52:54.027313 bus /sierra_3: Setting Powered False 09:52:55.144718 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:52:56.295221 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:56.307375 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:52:56.366249 tst mo_mt_call_osmux.py: using LAC 27572 09:52:56.495261 tst mo_mt_call_osmux.py: using RAC 32 09:52:56.621963 tst mo_mt_call_osmux.py: using CellId 27572 09:52:56.748617 tst mo_mt_call_osmux.py: using BVCI 27573 09:52:56.866429 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:56.878119 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:56.889593 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:56.901236 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:56.913000 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:52:56.924705 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:52:57.043633 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:52:57.161299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:52:57.633183 run create_hlr_db(pid=25724): Launched 09:52:57.758321 bus /sierra_2: Setting Powered False 09:52:58.818498 run create_hlr_db(pid=25724): Terminated: ok {rc=0} 09:52:59.260002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25726): Launched 09:52:59.583175 run osmo-hlr_10.42.42.2(pid=25727): Launched 09:52:59.706117 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:00.263543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25729): Launched 09:53:00.585669 run osmo-stp_10.42.42.5(pid=25730): Launched 09:53:00.704158 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:01.284643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25732): Launched 09:53:01.615510 run osmo-msc_10.42.42.6(pid=25733): Launched 09:53:02.005626 run osmo-stp_10.42.42.5(pid=25730): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25730)] 09:53:02.186761 run osmo-stp_10.42.42.5(pid=25730): stdout: | (launched: 2022-12-10_09:53:00.527454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:02.392240 run osmo-stp_10.42.42.5(pid=25730): stderr: | 20221210095300699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095300699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095300700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095300700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095300700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095300701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095300701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:02.528269 run osmo-stp_10.42.42.5(pid=25730): stdout: | (launched: 2022-12-10_09:53:00.527454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:02.657785 run osmo-stp_10.42.42.5(pid=25730): stderr: | 20221210095300699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095300699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095300700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095300700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095300700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095300701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095300701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:02.812685 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25730): Process ended prematurely: osmo-stp_10.42.42.5(pid=25730) [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25730)] [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:53:02.822229 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:53:02.850637 run osmo-hlr_10.42.42.2(pid=25727): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25727)] 09:53:02.901312 run osmo-hlr_10.42.42.2(pid=25727): stdout: | (launched: 2022-12-10_09:52:59.524833) 09:53:02.953440 run osmo-hlr_10.42.42.2(pid=25727): stderr: | 20221210095259721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095259721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095259721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095259721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095259722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095259722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095259734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095259745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095259745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095259745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:03.026417 run osmo-msc_10.42.42.6(pid=25733): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25733)] 09:53:03.077210 run osmo-msc_10.42.42.6(pid=25733): stdout: | (launched: 2022-12-10_09:53:01.541399) 09:53:03.129344 run osmo-msc_10.42.42.6(pid=25733): stderr: | 20221210095302034 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095302034 DLGLOBAL DEBUG validating counter group 0x7f7e5d3e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095302034 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095302034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095302034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095302035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095302036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095302049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095302050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095302050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:03.182151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25726): Terminating (SIGTERM) 09:53:03.224695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25729): Terminating (SIGTERM) 09:53:03.267090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25732): Terminating (SIGTERM) 09:53:03.309829 --- ParallelTerminationStrategy: PID 25726 died... 09:53:03.329946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25726): Terminated: ok {rc=0} 09:53:03.377047 --- ParallelTerminationStrategy: PID 25729 died... 09:53:03.396535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25729): Terminated: ok {rc=0} 09:53:03.443218 --- ParallelTerminationStrategy: PID 25732 died... 09:53:03.462777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25732): Terminated: ok {rc=0} 09:53:03.551858 bus /sierra_3: Setting Powered False 09:53:04.651426 bus /sierra_3: Setting Powered False 09:53:05.767231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:53:07.004839 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:07.010667 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:53:07.032381 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:53:07.060156 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:53:07.112820 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:53:07.134412 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:53:07.162621 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:53:07.711909 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:53:07.763905 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:07.775142 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:53:07.837788 tst mo_mt_call.py: using LAC 27573 09:53:07.967820 tst mo_mt_call.py: using RAC 33 09:53:08.094092 tst mo_mt_call.py: using CellId 27573 09:53:08.218631 tst mo_mt_call.py: using BVCI 27574 09:53:08.337145 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:08.348539 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:08.359637 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:08.371102 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:08.382539 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:08.394004 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:53:08.508180 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:53:08.629644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:09.127454 run create_hlr_db(pid=25738): Launched 09:53:09.249967 bus /sierra_2: Setting Powered False 09:53:10.313920 run create_hlr_db(pid=25738): Terminated: ok {rc=0} 09:53:10.762439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25740): Launched 09:53:11.083714 run osmo-hlr_10.42.42.2(pid=25741): Launched 09:53:11.207688 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:11.766413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25743): Launched 09:53:12.090101 run osmo-stp_10.42.42.5(pid=25744): Launched 09:53:12.214317 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:12.802583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25746): Launched 09:53:13.124867 run osmo-msc_10.42.42.6(pid=25747): Launched 09:53:13.305810 run osmo-stp_10.42.42.5(pid=25744): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25744)] 09:53:13.442771 run osmo-stp_10.42.42.5(pid=25744): stdout: | (launched: 2022-12-10_09:53:12.032154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:13.580669 run osmo-stp_10.42.42.5(pid=25744): stderr: | 20221210095312225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095312226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095312226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095312226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095312227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095312227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095312227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:13.717312 run osmo-stp_10.42.42.5(pid=25744): stdout: | (launched: 2022-12-10_09:53:12.032154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:13.845620 run osmo-stp_10.42.42.5(pid=25744): stderr: | 20221210095312225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095312226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095312226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095312226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095312227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095312227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095312227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:13.998937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25744): Process ended prematurely: osmo-stp_10.42.42.5(pid=25744) [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25744)] [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:53:14.008253 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:53:14.036282 run osmo-hlr_10.42.42.2(pid=25741): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25741)] 09:53:14.086417 run osmo-hlr_10.42.42.2(pid=25741): stdout: | (launched: 2022-12-10_09:53:11.026153) 09:53:14.138441 run osmo-hlr_10.42.42.2(pid=25741): stderr: | 20221210095311226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095311226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095311226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095311226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095311226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095311226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095311242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095311251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095311251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095311252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:14.210915 run osmo-msc_10.42.42.6(pid=25747): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25747)] 09:53:14.261094 run osmo-msc_10.42.42.6(pid=25747): stdout: | (launched: 2022-12-10_09:53:13.067165) 09:53:14.312752 run osmo-msc_10.42.42.6(pid=25747): stderr: | 20221210095313392 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095313392 DLGLOBAL DEBUG validating counter group 0x7fdd720bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095313392 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095313392 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095313392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095313393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095313394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095313395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095313395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095313395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:14.364903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25740): Terminating (SIGTERM) 09:53:14.406839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25743): Terminating (SIGTERM) 09:53:14.448629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25746): Terminating (SIGTERM) 09:53:14.490924 --- ParallelTerminationStrategy: PID 25740 died... 09:53:14.510722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25740): Terminated: ok {rc=0} 09:53:14.557046 --- ParallelTerminationStrategy: PID 25743 died... 09:53:14.576297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25743): Terminated: ok {rc=0} 09:53:14.623080 --- ParallelTerminationStrategy: PID 25746 died... 09:53:14.642449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25746): Terminated: ok {rc=0} 09:53:14.730235 bus /sierra_3: Setting Powered False 09:53:15.826124 bus /sierra_3: Setting Powered False 09:53:16.966125 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:53:18.170095 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:18.183339 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:53:18.257407 tst mo_mt_call_osmux.py: using LAC 27574 09:53:18.405111 tst mo_mt_call_osmux.py: using RAC 34 09:53:18.587406 tst mo_mt_call_osmux.py: using CellId 27574 09:53:18.722242 tst mo_mt_call_osmux.py: using BVCI 27575 09:53:18.835481 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:18.846985 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:18.858254 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:18.869612 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:18.881174 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:53:18.892380 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:53:19.011235 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:53:19.130873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:19.627484 run create_hlr_db(pid=26018): Launched 09:53:19.788155 bus /sierra_2: Setting Powered False 09:53:20.849368 run create_hlr_db(pid=26018): Terminated: ok {rc=0} 09:53:21.298254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26022): Launched 09:53:21.629683 run osmo-hlr_10.42.42.2(pid=26023): Launched 09:53:21.873106 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:22.597708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26025): Launched 09:53:22.931236 run osmo-stp_10.42.42.5(pid=26026): Launched 09:53:23.160648 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:23.908388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26028): Launched 09:53:24.233680 run osmo-msc_10.42.42.6(pid=26029): Launched 09:53:24.588125 run osmo-stp_10.42.42.5(pid=26026): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26026)] 09:53:24.872526 run osmo-stp_10.42.42.5(pid=26026): stdout: | (launched: 2022-12-10_09:53:22.857740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:25.047892 run osmo-stp_10.42.42.5(pid=26026): stderr: | 20221210095323190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095323190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095323190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095323190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095323191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095323191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095323191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:25.187061 run osmo-stp_10.42.42.5(pid=26026): stdout: | (launched: 2022-12-10_09:53:22.857740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:25.319159 run osmo-stp_10.42.42.5(pid=26026): stderr: | 20221210095323190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095323190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095323190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095323190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095323191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095323191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095323191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:25.476936 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26026): Process ended prematurely: osmo-stp_10.42.42.5(pid=26026) [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26026)] [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:53:25.487460 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 09:53:25.518952 run osmo-hlr_10.42.42.2(pid=26023): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26023)] 09:53:25.571930 run osmo-hlr_10.42.42.2(pid=26023): stdout: | (launched: 2022-12-10_09:53:21.558138) 09:53:25.626772 run osmo-hlr_10.42.42.2(pid=26023): stderr: | 20221210095321903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095321903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095321904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095321904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095321904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095321904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095321922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095321939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095321939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095321939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:25.702120 run osmo-msc_10.42.42.6(pid=26029): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26029)] 09:53:25.755018 run osmo-msc_10.42.42.6(pid=26029): stdout: | (launched: 2022-12-10_09:53:24.168521) 09:53:25.809383 run osmo-msc_10.42.42.6(pid=26029): stderr: | 20221210095324671 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095324672 DLGLOBAL DEBUG validating counter group 0x7f8c97831c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095324672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095324672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095324672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095324672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095324674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095324674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095324675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095324675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:25.864189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26022): Terminating (SIGTERM) 09:53:25.908937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26025): Terminating (SIGTERM) 09:53:25.954991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26028): Terminating (SIGTERM) 09:53:26.000080 --- ParallelTerminationStrategy: PID 26022 died... 09:53:26.020838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26022): Terminated: ok {rc=0} 09:53:26.072057 --- ParallelTerminationStrategy: PID 26025 died... 09:53:26.092801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26025): Terminated: ok {rc=0} 09:53:26.142839 --- ParallelTerminationStrategy: PID 26028 died... 09:53:26.163425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26028): Terminated: ok {rc=0} 09:53:26.256284 bus /sierra_3: Setting Powered False 09:53:27.360280 bus /sierra_3: Setting Powered False 09:53:28.482772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:sysmo --------------------------------------------------------------------- 09:53:29.726455 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:29.731328 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 09:53:29.753733 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 09:53:29.782909 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 09:53:29.869499 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 09:53:29.891744 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 09:53:29.919468 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 09:53:30.502664 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 09:53:30.509263 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:30.520722 tst emergency:sysmo: Using 1 x bts (candidates: 1) 09:53:30.557999 tst emergency_mo_mt_call.py: using LAC 27575 09:53:30.680171 tst emergency_mo_mt_call.py: using RAC 35 09:53:30.808091 tst emergency_mo_mt_call.py: using CellId 27575 09:53:30.963086 tst emergency_mo_mt_call.py: using BVCI 27576 09:53:31.085762 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:31.096867 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:31.108316 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:31.119605 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:31.131008 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:31.142582 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:53:31.278671 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:53:31.415446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:31.904304 run create_hlr_db(pid=26034): Launched 09:53:32.087080 bus /sierra_2: Setting Powered False 09:53:33.150199 run create_hlr_db(pid=26034): Terminated: ok {rc=0} 09:53:33.617733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26036): Launched 09:53:33.957677 run osmo-hlr_10.42.42.2(pid=26037): Launched 09:53:34.205314 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:34.870392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26039): Launched 09:53:35.213305 run osmo-stp_10.42.42.5(pid=26040): Launched 09:53:35.472579 tst emergency_mo_mt_call.py: using MSISDN 7677 09:53:35.715663 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:36.309084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26042): Launched 09:53:36.657666 run osmo-msc_10.42.42.6(pid=26043): Launched 09:53:37.015020 run osmo-stp_10.42.42.5(pid=26040): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26040)] 09:53:37.291777 run osmo-stp_10.42.42.5(pid=26040): stdout: | (launched: 2022-12-10_09:53:35.148431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:37.467422 run osmo-stp_10.42.42.5(pid=26040): stderr: | 20221210095335450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095335450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095335451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095335451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095335452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095335452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095335452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:37.606003 run osmo-stp_10.42.42.5(pid=26040): stdout: | (launched: 2022-12-10_09:53:35.148431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:37.737795 run osmo-stp_10.42.42.5(pid=26040): stderr: | 20221210095335450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095335450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095335451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095335451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095335452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095335452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095335452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:37.895035 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26040): Process ended prematurely: osmo-stp_10.42.42.5(pid=26040) [trial-2373↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26040)] [trial-2373↪emergency:sysmo↪emergency_mo_mt_call.py:19] 09:53:37.905275 tst emergency_mo_mt_call.py:19: Test FAILED (7.4 sec) 09:53:37.936448 run osmo-hlr_10.42.42.2(pid=26037): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26037)] 09:53:37.990177 run osmo-hlr_10.42.42.2(pid=26037): stdout: | (launched: 2022-12-10_09:53:33.889771) 09:53:38.045306 run osmo-hlr_10.42.42.2(pid=26037): stderr: | 20221210095334200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095334200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095334200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095334200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095334200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095334200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095334223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095334231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095334231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095334232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:38.121630 run osmo-msc_10.42.42.6(pid=26043): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26043)] 09:53:38.175498 run osmo-msc_10.42.42.6(pid=26043): stdout: | (launched: 2022-12-10_09:53:36.587187) 09:53:38.230923 run osmo-msc_10.42.42.6(pid=26043): stderr: | 20221210095337096 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095337096 DLGLOBAL DEBUG validating counter group 0x7ff1dbd85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095337096 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095337096 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095337096 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095337096 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095337098 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095337099 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095337099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095337099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:38.286735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26036): Terminating (SIGTERM) 09:53:38.332355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26039): Terminating (SIGTERM) 09:53:38.379348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26042): Terminating (SIGTERM) 09:53:38.426845 --- ParallelTerminationStrategy: PID 26036 died... 09:53:38.447990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26036): Terminated: ok {rc=0} 09:53:38.499838 --- ParallelTerminationStrategy: PID 26039 died... 09:53:38.520654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26039): Terminated: ok {rc=0} 09:53:38.571189 --- ParallelTerminationStrategy: PID 26042 died... 09:53:38.591938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26042): Terminated: ok {rc=0} 09:53:38.685734 bus /sierra_3: Setting Powered False 09:53:39.786992 bus /sierra_3: Setting Powered False 09:53:40.902774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 09:53:41.990459 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:42.002359 tst emergency:sysmo: Using 1 x bts (candidates: 1) 09:53:42.041960 tst emergency_preemptive_call.py: using LAC 27576 09:53:42.168016 tst emergency_preemptive_call.py: using RAC 36 09:53:42.292858 tst emergency_preemptive_call.py: using CellId 27576 09:53:42.422103 tst emergency_preemptive_call.py: using BVCI 27577 09:53:42.538718 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:42.549905 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:42.560747 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:42.571907 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:42.583047 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 09:53:42.594162 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:53:42.715446 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:53:42.829520 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:53:42.947584 tst emergency:sysmo: Using 1 x modem (candidates: 4) 09:53:43.061037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:53:43.521025 run create_hlr_db(pid=26046): Launched 09:53:43.642548 bus /sierra_2: Setting Powered False 09:53:44.701939 run create_hlr_db(pid=26046): Terminated: ok {rc=0} 09:53:45.137697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26048): Launched 09:53:45.455944 run osmo-hlr_10.42.42.2(pid=26049): Launched 09:53:45.577506 run osmo-stp_10.42.42.5: Starting osmo-stp 09:53:46.163585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26051): Launched 09:53:46.533781 run osmo-stp_10.42.42.5(pid=26052): Launched 09:53:46.831654 tst emergency_preemptive_call.py: using MSISDN 7678 09:53:47.044664 run osmo-msc_10.42.42.6: Starting osmo-msc 09:53:47.585519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26054): Launched 09:53:47.882592 run osmo-msc_10.42.42.6(pid=26055): Launched 09:53:48.053508 run osmo-stp_10.42.42.5(pid=26052): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26052)] 09:53:48.178362 run osmo-stp_10.42.42.5(pid=26052): stdout: | (launched: 2022-12-10_09:53:46.465536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:48.303649 run osmo-stp_10.42.42.5(pid=26052): stderr: | 20221210095346685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095346685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095346685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095346686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095346686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095346686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095346686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:48.427271 run osmo-stp_10.42.42.5(pid=26052): stdout: | (launched: 2022-12-10_09:53:46.465536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:53:48.545431 run osmo-stp_10.42.42.5(pid=26052): stderr: | 20221210095346685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095346685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095346685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095346686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095346686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095346686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095346686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:53:48.686566 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26052): Process ended prematurely: osmo-stp_10.42.42.5(pid=26052) [trial-2373↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26052)] [trial-2373↪emergency:sysmo↪emergency_preemptive_call.py:32] 09:53:48.694769 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 09:53:48.720440 run osmo-hlr_10.42.42.2(pid=26049): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26049)] 09:53:48.767960 run osmo-hlr_10.42.42.2(pid=26049): stdout: | (launched: 2022-12-10_09:53:45.398732) 09:53:48.817403 run osmo-hlr_10.42.42.2(pid=26049): stderr: | 20221210095345597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095345597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095345597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095345598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095345598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095345598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095345611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095345619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095345619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095345619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:53:48.885698 run osmo-msc_10.42.42.6(pid=26055): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26055)] 09:53:48.933253 run osmo-msc_10.42.42.6(pid=26055): stdout: | (launched: 2022-12-10_09:53:47.828229) 09:53:48.982077 run osmo-msc_10.42.42.6(pid=26055): stderr: | 20221210095348101 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095348101 DLGLOBAL DEBUG validating counter group 0x7f3ea3834c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095348101 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095348101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095348101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095348101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095348104 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095348105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095348105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095348105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:53:49.031304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26048): Terminating (SIGTERM) 09:53:49.070705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26051): Terminating (SIGTERM) 09:53:49.110601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26054): Terminating (SIGTERM) 09:53:49.150378 --- ParallelTerminationStrategy: PID 26048 died... 09:53:49.169278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26048): Terminated: ok {rc=0} 09:53:49.212797 --- ParallelTerminationStrategy: PID 26051 died... 09:53:49.231239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26051): Terminated: ok {rc=0} 09:53:49.274702 --- ParallelTerminationStrategy: PID 26054 died... 09:53:49.293227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26054): Terminated: ok {rc=0} 09:53:49.376546 bus /sierra_9: Setting Powered False 09:53:50.471046 bus /sierra_9: Setting Powered False 09:53:51.584832 bus /sierra_8: Setting Powered False 09:53:52.683674 bus /sierra_8: Setting Powered False 09:53:53.798921 bus /sierra_3: Setting Powered False 09:53:54.896574 bus /sierra_3: Setting Powered False 09:53:56.011651 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:sysmo --------------------------------------------------------------------- 09:53:57.276176 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:53:57.281043 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 09:53:57.302713 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 09:53:57.342471 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 09:53:57.431246 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 09:53:57.452430 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 09:53:57.492080 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 09:53:58.082802 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 09:53:58.137095 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.147920 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:53:58.184132 tst cs_paging_gprs_active.py: using LAC 27577 09:53:58.312350 tst cs_paging_gprs_active.py: using RAC 37 09:53:58.438886 tst cs_paging_gprs_active.py: using CellId 27577 09:53:58.565127 tst cs_paging_gprs_active.py: using BVCI 27578 09:53:58.682823 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.693812 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.704625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.715698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.726668 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.737740 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.748841 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.759816 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:53:58.771046 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:53:58.887527 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:53:59.002547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:53:59.206743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:53:59.511532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Launched 09:53:59.775217 run iperf3-srv_10.42.42.10(pid=26062): Launched 09:53:59.888567 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:54:00.091358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:54:00.394604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Launched 09:54:00.656789 run iperf3-srv_10.42.42.10(pid=26064): Launched 09:54:00.769344 tst cs_paging_gprs_active.py:38: start network... 09:54:00.983113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:01.463265 run create_hlr_db(pid=26065): Launched 09:54:01.622991 bus /sierra_2: Setting Powered False 09:54:02.683020 run create_hlr_db(pid=26065): Terminated: ok {rc=0} 09:54:03.105582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Launched 09:54:03.408595 run osmo-hlr_10.42.42.2(pid=26068): Launched 09:54:03.524024 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:04.045585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Launched 09:54:04.348166 run osmo-stp_10.42.42.5(pid=26071): Launched 09:54:04.464134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:54:05.973658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Launched 09:54:06.089471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:54:06.344672 run patchelf(pid=26074): Launched 09:54:06.514449 run osmo-stp_10.42.42.5(pid=26071): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] 09:54:06.643215 run osmo-stp_10.42.42.5(pid=26071): stdout: | (launched: 2022-12-10_09:54:04.293217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:06.773463 run osmo-stp_10.42.42.5(pid=26071): stderr: | 20221210095404466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095404467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095404467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095404467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095404468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095404468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095404468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:06.903456 run osmo-stp_10.42.42.5(pid=26071): stdout: | (launched: 2022-12-10_09:54:04.293217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:07.027583 run osmo-stp_10.42.42.5(pid=26071): stderr: | 20221210095404466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095404467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095404467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095404467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095404468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095404468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095404468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:07.174847 run patchelf(pid=26074): Terminating (SIGINT) 09:54:07.345774 run patchelf(pid=26074): Terminated: ok {rc=0} 09:54:07.468866 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26071): Process ended prematurely: osmo-stp_10.42.42.5(pid=26071) [trial-2373↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] [trial-2373↪gprs:sysmo↪cs_paging_gprs_active.py:38] 09:54:07.478150 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 09:54:07.505258 run osmo-hlr_10.42.42.2(pid=26068): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26068)] 09:54:07.552830 run osmo-hlr_10.42.42.2(pid=26068): stdout: | (launched: 2022-12-10_09:54:03.353767) 09:54:07.602027 run osmo-hlr_10.42.42.2(pid=26068): stderr: | 20221210095403531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095403531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095403532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095403532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095403532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095403532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095403547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095403557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095403557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095403558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:07.651593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminating (SIGTERM) 09:54:07.691684 run iperf3-srv_10.42.42.10(pid=26062): Terminating (SIGTERM) 09:54:07.731590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Terminating (SIGTERM) 09:54:07.771350 run iperf3-srv_10.42.42.10(pid=26064): Terminating (SIGTERM) 09:54:07.810962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Terminating (SIGTERM) 09:54:07.850873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Terminating (SIGTERM) 09:54:07.890416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Terminating (SIGTERM) 09:54:07.930207 --- ParallelTerminationStrategy: PID 26061 died... 09:54:07.949327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminated: ok {rc=0} 09:54:07.993528 --- ParallelTerminationStrategy: PID 26062 died... 09:54:08.011983 run iperf3-srv_10.42.42.10(pid=26062): Terminated {rc=256} 09:54:08.055790 --- ParallelTerminationStrategy: PID 26063 died... 09:54:08.074645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26063): Terminated: ok {rc=0} 09:54:08.118502 --- ParallelTerminationStrategy: PID 26064 died... 09:54:08.137011 run iperf3-srv_10.42.42.10(pid=26064): Terminated {rc=256} 09:54:08.181238 --- ParallelTerminationStrategy: PID 26067 died... 09:54:08.199844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26067): Terminated: ok {rc=0} 09:54:08.244145 --- ParallelTerminationStrategy: PID 26070 died... 09:54:08.262905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26070): Terminated: ok {rc=0} 09:54:08.306614 --- ParallelTerminationStrategy: PID 26073 died... 09:54:08.325320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26073): Terminated: ok {rc=0} 09:54:08.411057 bus /gobi_0: Setting Powered False 09:54:09.512170 bus /gobi_0: Setting Powered False 09:54:10.627673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo iperf3.py ---------------------------------------------- 09:54:11.775753 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:11.786952 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:54:11.821961 tst iperf3.py: using LAC 27578 09:54:11.949193 tst iperf3.py: using RAC 38 09:54:12.077389 tst iperf3.py: using CellId 27578 09:54:12.204720 tst iperf3.py: using BVCI 27579 09:54:12.322387 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.333393 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.344262 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.355293 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.366257 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.377331 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.388361 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.399336 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:12.410479 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:54:12.530896 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:54:12.749890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:54:13.073356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Launched 09:54:13.356120 run iperf3-srv_10.42.42.10(pid=26076): Launched 09:54:13.477483 tst iperf3.py:8: start network... 09:54:13.695803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:14.196814 run create_hlr_db(pid=26077): Launched 09:54:14.320637 bus /gobi_6: Setting Powered False 09:54:15.384398 run create_hlr_db(pid=26077): Terminated: ok {rc=0} 09:54:15.816453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26079): Launched 09:54:16.179936 run osmo-hlr_10.42.42.2(pid=26080): Launched 09:54:16.355942 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:17.082849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26082): Launched 09:54:17.414771 run osmo-stp_10.42.42.5(pid=26083): Launched 09:54:17.539884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:54:18.097439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26085): Launched 09:54:18.222507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:54:18.495619 run patchelf(pid=26086): Launched 09:54:18.675744 run osmo-stp_10.42.42.5(pid=26083): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26083)] 09:54:18.813373 run osmo-stp_10.42.42.5(pid=26083): stdout: | (launched: 2022-12-10_09:54:17.355781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:18.952544 run osmo-stp_10.42.42.5(pid=26083): stderr: | 20221210095417544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095417544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095417545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095417545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095417547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095417547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095417548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:19.091596 run osmo-stp_10.42.42.5(pid=26083): stdout: | (launched: 2022-12-10_09:54:17.355781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:19.224548 run osmo-stp_10.42.42.5(pid=26083): stderr: | 20221210095417544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095417544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095417545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095417545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095417547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095417547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095417548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:19.382286 run patchelf(pid=26086): Terminating (SIGINT) 09:54:19.563803 run patchelf(pid=26086): Terminated: ok {rc=0} 09:54:19.694885 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26083): Process ended prematurely: osmo-stp_10.42.42.5(pid=26083) [trial-2373↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26083)] [trial-2373↪gprs:sysmo↪iperf3.py:8] 09:54:19.704826 tst iperf3.py:8: Test FAILED (8.0 sec) 09:54:19.733547 run osmo-hlr_10.42.42.2(pid=26080): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26080)] 09:54:19.784377 run osmo-hlr_10.42.42.2(pid=26080): stdout: | (launched: 2022-12-10_09:54:16.114429) 09:54:19.836874 run osmo-hlr_10.42.42.2(pid=26080): stderr: | 20221210095416467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095416467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095416467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095416467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095416467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095416467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095416486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095416494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095416494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095416494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:19.889514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Terminating (SIGTERM) 09:54:19.931595 run iperf3-srv_10.42.42.10(pid=26076): Terminating (SIGTERM) 09:54:19.973701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26079): Terminating (SIGTERM) 09:54:20.015941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26082): Terminating (SIGTERM) 09:54:20.057945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26085): Terminating (SIGTERM) 09:54:20.100185 --- ParallelTerminationStrategy: PID 26075 died... 09:54:20.120032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Terminated: ok {rc=0} 09:54:20.166904 --- ParallelTerminationStrategy: PID 26076 died... 09:54:20.186479 run iperf3-srv_10.42.42.10(pid=26076): Terminated {rc=256} 09:54:20.233396 --- ParallelTerminationStrategy: PID 26079 died... 09:54:20.252689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26079): Terminated: ok {rc=0} 09:54:20.299555 --- ParallelTerminationStrategy: PID 26082 died... 09:54:20.319162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26082): Terminated: ok {rc=0} 09:54:20.366010 --- ParallelTerminationStrategy: PID 26085 died... 09:54:20.385493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26085): Terminated: ok {rc=0} 09:54:20.474106 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo iperf3m4.py ---------------------------------------------- 09:54:21.625669 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:21.637219 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:54:21.674324 tst iperf3m4.py: using LAC 27579 09:54:21.802519 tst iperf3m4.py: using RAC 39 09:54:21.930818 tst iperf3m4.py: using CellId 27579 09:54:22.057750 tst iperf3m4.py: using BVCI 27580 09:54:22.177077 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.188126 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.199038 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.210541 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.221669 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.232373 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.243537 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.254738 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:22.265909 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:54:22.383929 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:54:22.502785 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:54:22.618788 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:54:22.736740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:54:22.958139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:54:23.283518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26087): Launched 09:54:23.565156 run iperf3-srv_10.42.42.10(pid=26088): Launched 09:54:23.687061 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:54:23.906427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:54:24.231893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26089): Launched 09:54:24.513247 run iperf3-srv_10.42.42.10(pid=26090): Launched 09:54:24.634616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:54:24.853660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:54:25.178225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26091): Launched 09:54:25.459107 run iperf3-srv_10.42.42.10(pid=26092): Launched 09:54:25.580187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:54:25.797384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:54:26.120820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26093): Launched 09:54:26.416223 run iperf3-srv_10.42.42.10(pid=26094): Launched 09:54:26.537403 tst iperf3m4.py:8: start network... 09:54:26.755041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:27.255953 run create_hlr_db(pid=26095): Launched 09:54:27.379245 bus /gobi_6: Setting Powered False 09:54:28.442918 run create_hlr_db(pid=26095): Terminated: ok {rc=0} 09:54:28.892391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26097): Launched 09:54:29.216315 run osmo-hlr_10.42.42.2(pid=26098): Launched 09:54:29.339792 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:29.900668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26100): Launched 09:54:30.223260 run osmo-stp_10.42.42.5(pid=26101): Launched 09:54:30.347677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:54:30.935286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26103): Launched 09:54:31.067891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:54:31.357662 run patchelf(pid=26104): Launched 09:54:31.548876 run osmo-stp_10.42.42.5(pid=26101): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26101)] 09:54:31.689839 run osmo-stp_10.42.42.5(pid=26101): stdout: | (launched: 2022-12-10_09:54:30.164643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:31.832605 run osmo-stp_10.42.42.5(pid=26101): stderr: | 20221210095430358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095430358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095430358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095430359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095430359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095430359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095430359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:31.975456 run osmo-stp_10.42.42.5(pid=26101): stdout: | (launched: 2022-12-10_09:54:30.164643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:32.111621 run osmo-stp_10.42.42.5(pid=26101): stderr: | 20221210095430358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095430358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095430358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095430359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095430359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095430359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095430359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:32.272745 run patchelf(pid=26104): Terminating (SIGINT) 09:54:32.454760 run patchelf(pid=26104): Terminated: ok {rc=0} 09:54:32.586431 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26101): Process ended prematurely: osmo-stp_10.42.42.5(pid=26101) [trial-2373↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26101)] [trial-2373↪gprs:sysmo↪iperf3m4.py:8] 09:54:32.596648 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:54:32.626535 run osmo-hlr_10.42.42.2(pid=26098): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26098)] 09:54:32.678401 run osmo-hlr_10.42.42.2(pid=26098): stdout: | (launched: 2022-12-10_09:54:29.156760) 09:54:32.731264 run osmo-hlr_10.42.42.2(pid=26098): stderr: | 20221210095429354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095429354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095429354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095429354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095429354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095429354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095429367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095429375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095429375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095429376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:32.784496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26087): Terminating (SIGTERM) 09:54:32.827274 run iperf3-srv_10.42.42.10(pid=26088): Terminating (SIGTERM) 09:54:32.869975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26089): Terminating (SIGTERM) 09:54:32.912855 run iperf3-srv_10.42.42.10(pid=26090): Terminating (SIGTERM) 09:54:32.955666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26091): Terminating (SIGTERM) 09:54:32.998659 run iperf3-srv_10.42.42.10(pid=26092): Terminating (SIGTERM) 09:54:33.041488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26093): Terminating (SIGTERM) 09:54:33.084218 run iperf3-srv_10.42.42.10(pid=26094): Terminating (SIGTERM) 09:54:33.126895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26097): Terminating (SIGTERM) 09:54:33.169782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26100): Terminating (SIGTERM) 09:54:33.212807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26103): Terminating (SIGTERM) 09:54:33.255784 --- ParallelTerminationStrategy: PID 26087 died... 09:54:33.276191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26087): Terminated: ok {rc=0} 09:54:33.323855 --- ParallelTerminationStrategy: PID 26088 died... 09:54:33.343710 run iperf3-srv_10.42.42.10(pid=26088): Terminated {rc=256} 09:54:33.391164 --- ParallelTerminationStrategy: PID 26089 died... 09:54:33.411027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26089): Terminated: ok {rc=0} 09:54:33.458479 --- ParallelTerminationStrategy: PID 26090 died... 09:54:33.478260 run iperf3-srv_10.42.42.10(pid=26090): Terminated {rc=256} 09:54:33.525803 --- ParallelTerminationStrategy: PID 26091 died... 09:54:33.545830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26091): Terminated: ok {rc=0} 09:54:33.593264 --- ParallelTerminationStrategy: PID 26092 died... 09:54:33.613211 run iperf3-srv_10.42.42.10(pid=26092): Terminated {rc=256} 09:54:33.660469 --- ParallelTerminationStrategy: PID 26093 died... 09:54:33.680270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26093): Terminated: ok {rc=0} 09:54:33.727659 --- ParallelTerminationStrategy: PID 26094 died... 09:54:33.747606 run iperf3-srv_10.42.42.10(pid=26094): Terminated {rc=256} 09:54:33.794948 --- ParallelTerminationStrategy: PID 26097 died... 09:54:33.814956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26097): Terminated: ok {rc=0} 09:54:33.862238 --- ParallelTerminationStrategy: PID 26100 died... 09:54:33.882053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26100): Terminated: ok {rc=0} 09:54:33.929598 --- ParallelTerminationStrategy: PID 26103 died... 09:54:33.949554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26103): Terminated: ok {rc=0} 09:54:34.038493 bus /gobi_4: Setting Powered False 09:54:35.137705 bus /gobi_4: Setting Powered False 09:54:36.251258 bus /gobi_1: Setting Powered False 09:54:37.347018 bus /gobi_1: Setting Powered False 09:54:38.462822 bus /gobi_0: Setting Powered False 09:54:39.561904 bus /gobi_0: Setting Powered False 09:54:40.678262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo ping.py ---------------------------------------------- 09:54:41.782338 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:41.793573 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:54:41.833638 tst ping.py: using LAC 27580 09:54:41.952109 tst ping.py: using RAC 40 09:54:42.076764 tst ping.py: using CellId 27580 09:54:42.200404 tst ping.py: using BVCI 27581 09:54:42.317124 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:42.328157 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:42.339298 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:42.351001 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:42.361917 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:42.372818 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:42.383980 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:42.395140 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:54:42.510639 tst ping.py:19: start network... 09:54:42.711023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:43.171408 run create_hlr_db(pid=26105): Launched 09:54:43.292142 bus /gobi_6: Setting Powered False 09:54:44.352381 run create_hlr_db(pid=26105): Terminated: ok {rc=0} 09:54:44.786410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26107): Launched 09:54:45.102443 run osmo-hlr_10.42.42.2(pid=26108): Launched 09:54:45.223555 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:45.771971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26110): Launched 09:54:46.109241 run osmo-stp_10.42.42.5(pid=26111): Launched 09:54:46.384409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:54:46.997593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26113): Launched 09:54:47.114832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:54:47.374585 run patchelf(pid=26114): Launched 09:54:47.542432 run osmo-stp_10.42.42.5(pid=26111): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26111)] 09:54:47.669375 run osmo-stp_10.42.42.5(pid=26111): stdout: | (launched: 2022-12-10_09:54:46.044050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:47.797919 run osmo-stp_10.42.42.5(pid=26111): stderr: | 20221210095446332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095446332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095446333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095446333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095446334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095446334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095446334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:47.926662 run osmo-stp_10.42.42.5(pid=26111): stdout: | (launched: 2022-12-10_09:54:46.044050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:48.049852 run osmo-stp_10.42.42.5(pid=26111): stderr: | 20221210095446332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095446332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095446333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095446333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095446334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095446334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095446334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:48.194787 run patchelf(pid=26114): Terminating (SIGINT) 09:54:48.362852 run patchelf(pid=26114): Terminated: ok {rc=0} 09:54:48.484039 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26111): Process ended prematurely: osmo-stp_10.42.42.5(pid=26111) [trial-2373↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26111)] [trial-2373↪gprs:sysmo↪ping.py:22] 09:54:48.492888 tst ping.py:22: Test FAILED (6.7 sec) 09:54:48.519615 run osmo-hlr_10.42.42.2(pid=26108): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26108)] 09:54:48.567401 run osmo-hlr_10.42.42.2(pid=26108): stdout: | (launched: 2022-12-10_09:54:45.045462) 09:54:48.617285 run osmo-hlr_10.42.42.2(pid=26108): stderr: | 20221210095445245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095445245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095445245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095445245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095445246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095445246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095445270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095445281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095445281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095445281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:48.667489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26107): Terminating (SIGTERM) 09:54:48.707625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26110): Terminating (SIGTERM) 09:54:48.747692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26113): Terminating (SIGTERM) 09:54:48.788326 --- ParallelTerminationStrategy: PID 26107 died... 09:54:48.807681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26107): Terminated: ok {rc=0} 09:54:48.852422 --- ParallelTerminationStrategy: PID 26110 died... 09:54:48.871156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26110): Terminated: ok {rc=0} 09:54:48.915212 --- ParallelTerminationStrategy: PID 26113 died... 09:54:48.933938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26113): Terminated: ok {rc=0} 09:54:49.018775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 09:54:50.108471 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.120090 tst gprs:sysmo: Using 1 x bts (candidates: 1) 09:54:50.157482 tst ping_idle_ping.py: using LAC 27581 09:54:50.286391 tst ping_idle_ping.py: using RAC 41 09:54:50.412283 tst ping_idle_ping.py: using CellId 27581 09:54:50.541697 tst ping_idle_ping.py: using BVCI 27582 09:54:50.651501 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.662250 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.673263 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.683816 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.694325 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.704732 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.715402 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 09:54:50.725935 tst gprs:sysmo: Using 1 x modem (candidates: 4) 09:54:50.850363 tst ping_idle_ping.py:24: start network... 09:54:51.066785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:54:51.559450 run create_hlr_db(pid=26115): Launched 09:54:51.680237 bus /gobi_6: Setting Powered False 09:54:52.743397 run create_hlr_db(pid=26115): Terminated: ok {rc=0} 09:54:53.186891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Launched 09:54:53.503877 run osmo-hlr_10.42.42.2(pid=26118): Launched 09:54:53.625857 run osmo-stp_10.42.42.5: Starting osmo-stp 09:54:54.176080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Launched 09:54:54.493827 run osmo-stp_10.42.42.5(pid=26121): Launched 09:54:54.615510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:54:55.164225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Launched 09:54:55.287343 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:54:55.556336 run patchelf(pid=26124): Launched 09:54:55.733836 run osmo-stp_10.42.42.5(pid=26121): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] 09:54:55.868831 run osmo-stp_10.42.42.5(pid=26121): stdout: | (launched: 2022-12-10_09:54:54.436753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:56.005948 run osmo-stp_10.42.42.5(pid=26121): stderr: | 20221210095454627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095454627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095454627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095454628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095454628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095454628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095454628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:56.143241 run osmo-stp_10.42.42.5(pid=26121): stdout: | (launched: 2022-12-10_09:54:54.436753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:54:56.274932 run osmo-stp_10.42.42.5(pid=26121): stderr: | 20221210095454627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095454627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095454627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095454628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095454628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095454628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095454628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:54:56.429589 run patchelf(pid=26124): Terminating (SIGINT) 09:54:56.608048 run patchelf(pid=26124): Terminated: ok {rc=0} 09:54:56.737015 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26121): Process ended prematurely: osmo-stp_10.42.42.5(pid=26121) [trial-2373↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] [trial-2373↪gprs:sysmo↪ping_idle_ping.py:27] 09:54:56.746292 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:54:56.774468 run osmo-hlr_10.42.42.2(pid=26118): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26118)] 09:54:56.824219 run osmo-hlr_10.42.42.2(pid=26118): stdout: | (launched: 2022-12-10_09:54:53.446984) 09:54:56.875986 run osmo-hlr_10.42.42.2(pid=26118): stderr: | 20221210095453646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095453646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095453646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095453646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095453647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095453647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095453659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095453667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095453668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095453668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:54:56.927913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminating (SIGTERM) 09:54:56.969704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminating (SIGTERM) 09:54:57.011344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Terminating (SIGTERM) 09:54:57.053315 --- ParallelTerminationStrategy: PID 26117 died... 09:54:57.072934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminated: ok {rc=0} 09:54:57.119464 --- ParallelTerminationStrategy: PID 26120 died... 09:54:57.138822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminated: ok {rc=0} 09:54:57.184928 --- ParallelTerminationStrategy: PID 26123 died... 09:54:57.204666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26123): Terminated: ok {rc=0} 09:54:57.293009 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 09:54:58.582787 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:54:58.588812 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:54:58.610766 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:54:58.651564 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:54:58.742819 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:54:58.763769 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:54:58.801750 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:54:59.395083 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:54:59.448110 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:54:59.459415 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:54:59.501252 tst cs_paging_gprs_active.py: using LAC 27582 09:54:59.627808 tst cs_paging_gprs_active.py: using RAC 42 09:54:59.753342 tst cs_paging_gprs_active.py: using CellId 27582 09:54:59.878266 tst cs_paging_gprs_active.py: using BVCI 27583 09:54:59.996660 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.007977 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.018946 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.030503 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.042000 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.053249 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.064687 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.076188 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:00.088177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:00.204909 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:00.325121 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:55:00.530515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:55:00.847350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26129): Launched 09:55:01.169549 run iperf3-srv_10.42.42.10(pid=26130): Launched 09:55:01.287177 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:55:01.507137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:55:01.831846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26134): Launched 09:55:02.203230 run iperf3-srv_10.42.42.10(pid=26135): Launched 09:55:02.333902 tst cs_paging_gprs_active.py:38: start network... 09:55:02.536604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:03.005835 run create_hlr_db(pid=26136): Launched 09:55:03.130124 bus /gobi_6: Setting Powered False 09:55:04.191073 run create_hlr_db(pid=26136): Terminated: ok {rc=0} 09:55:04.612835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26138): Launched 09:55:04.914726 run osmo-hlr_10.42.42.2(pid=26139): Launched 09:55:05.029546 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:05.548507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26141): Launched 09:55:05.852103 run osmo-stp_10.42.42.5(pid=26142): Launched 09:55:05.969450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:55:06.494319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26144): Launched 09:55:06.609955 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:55:06.864641 run patchelf(pid=26145): Launched 09:55:07.033427 run osmo-stp_10.42.42.5(pid=26142): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26142)] 09:55:07.161839 run osmo-stp_10.42.42.5(pid=26142): stdout: | (launched: 2022-12-10_09:55:05.796595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:07.292136 run osmo-stp_10.42.42.5(pid=26142): stderr: | 20221210095505965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095505965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095505966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095505966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095505968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095505969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095505969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:07.422291 run osmo-stp_10.42.42.5(pid=26142): stdout: | (launched: 2022-12-10_09:55:05.796595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:07.546379 run osmo-stp_10.42.42.5(pid=26142): stderr: | 20221210095505965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095505965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095505966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095505966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095505968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095505969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095505969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:07.693830 run patchelf(pid=26145): Terminating (SIGINT) 09:55:07.864352 run patchelf(pid=26145): Terminated: ok {rc=0} 09:55:07.987489 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26142): Process ended prematurely: osmo-stp_10.42.42.5(pid=26142) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26142)] [trial-2373↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:55:07.996857 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:55:08.023918 run osmo-hlr_10.42.42.2(pid=26139): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26139)] 09:55:08.071334 run osmo-hlr_10.42.42.2(pid=26139): stdout: | (launched: 2022-12-10_09:55:04.860046) 09:55:08.120471 run osmo-hlr_10.42.42.2(pid=26139): stderr: | 20221210095505037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095505037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095505037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095505037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095505037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095505037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095505049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095505058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095505058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095505058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:08.170471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26129): Terminating (SIGTERM) 09:55:08.211135 run iperf3-srv_10.42.42.10(pid=26130): Terminating (SIGTERM) 09:55:08.250872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26134): Terminating (SIGTERM) 09:55:08.290758 run iperf3-srv_10.42.42.10(pid=26135): Terminating (SIGTERM) 09:55:08.330338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26138): Terminating (SIGTERM) 09:55:08.370063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26141): Terminating (SIGTERM) 09:55:08.409659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26144): Terminating (SIGTERM) 09:55:08.449484 --- ParallelTerminationStrategy: PID 26129 died... 09:55:08.468451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26129): Terminated: ok {rc=0} 09:55:08.512232 --- ParallelTerminationStrategy: PID 26130 died... 09:55:08.530678 run iperf3-srv_10.42.42.10(pid=26130): Terminated {rc=256} 09:55:08.574715 --- ParallelTerminationStrategy: PID 26134 died... 09:55:08.593264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26134): Terminated: ok {rc=0} 09:55:08.636723 --- ParallelTerminationStrategy: PID 26135 died... 09:55:08.655114 run iperf3-srv_10.42.42.10(pid=26135): Terminated {rc=256} 09:55:08.698613 --- ParallelTerminationStrategy: PID 26138 died... 09:55:08.717092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26138): Terminated: ok {rc=0} 09:55:08.761159 --- ParallelTerminationStrategy: PID 26141 died... 09:55:08.779599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26141): Terminated: ok {rc=0} 09:55:08.823342 --- ParallelTerminationStrategy: PID 26144 died... 09:55:08.841842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26144): Terminated: ok {rc=0} 09:55:08.927085 bus /gobi_0: Setting Powered False 09:55:10.025720 bus /gobi_0: Setting Powered False 09:55:11.140205 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:55:12.292056 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.304052 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:55:12.343445 tst iperf3.py: using LAC 27583 09:55:12.470822 tst iperf3.py: using RAC 43 09:55:12.601943 tst iperf3.py: using CellId 27583 09:55:12.729977 tst iperf3.py: using BVCI 27584 09:55:12.848024 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.859471 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.870589 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.882177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.893522 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.904786 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.916441 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.927972 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:12.939736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:13.061457 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:55:13.281745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:55:13.605879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26147): Launched 09:55:13.887316 run iperf3-srv_10.42.42.10(pid=26148): Launched 09:55:14.009000 tst iperf3.py:8: start network... 09:55:14.227952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:14.729380 run create_hlr_db(pid=26149): Launched 09:55:14.851984 bus /gobi_6: Setting Powered False 09:55:15.932392 run create_hlr_db(pid=26149): Terminated: ok {rc=0} 09:55:16.399140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26151): Launched 09:55:16.730365 run osmo-hlr_10.42.42.2(pid=26152): Launched 09:55:16.899055 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:17.651058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26154): Launched 09:55:17.973400 run osmo-stp_10.42.42.5(pid=26155): Launched 09:55:18.097374 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:55:18.659699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26157): Launched 09:55:18.783962 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:55:19.056657 run patchelf(pid=26158): Launched 09:55:19.237592 run osmo-stp_10.42.42.5(pid=26155): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26155)] 09:55:19.375368 run osmo-stp_10.42.42.5(pid=26155): stdout: | (launched: 2022-12-10_09:55:17.915467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:19.514881 run osmo-stp_10.42.42.5(pid=26155): stderr: | 20221210095518108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095518108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095518108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095518108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095518109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095518109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095518109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:19.654614 run osmo-stp_10.42.42.5(pid=26155): stdout: | (launched: 2022-12-10_09:55:17.915467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:19.787412 run osmo-stp_10.42.42.5(pid=26155): stderr: | 20221210095518108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095518108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095518108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095518108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095518109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095518109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095518109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:19.944829 run patchelf(pid=26158): Terminating (SIGINT) 09:55:20.127346 run patchelf(pid=26158): Terminated: ok {rc=0} 09:55:20.259704 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26155): Process ended prematurely: osmo-stp_10.42.42.5(pid=26155) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26155)] [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 09:55:20.269750 tst iperf3.py:8: Test FAILED (8.0 sec) 09:55:20.299097 run osmo-hlr_10.42.42.2(pid=26152): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26152)] 09:55:20.349963 run osmo-hlr_10.42.42.2(pid=26152): stdout: | (launched: 2022-12-10_09:55:16.654827) 09:55:20.402319 run osmo-hlr_10.42.42.2(pid=26152): stderr: | 20221210095517030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095517030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095517030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095517030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095517030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095517030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095517046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095517065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095517066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095517066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:20.455028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26147): Terminating (SIGTERM) 09:55:20.497415 run iperf3-srv_10.42.42.10(pid=26148): Terminating (SIGTERM) 09:55:20.539683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26151): Terminating (SIGTERM) 09:55:20.581949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26154): Terminating (SIGTERM) 09:55:20.624107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26157): Terminating (SIGTERM) 09:55:20.666641 --- ParallelTerminationStrategy: PID 26147 died... 09:55:20.686641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26147): Terminated: ok {rc=0} 09:55:20.733983 --- ParallelTerminationStrategy: PID 26148 died... 09:55:20.753726 run iperf3-srv_10.42.42.10(pid=26148): Terminated {rc=256} 09:55:20.800457 --- ParallelTerminationStrategy: PID 26151 died... 09:55:20.820050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26151): Terminated: ok {rc=0} 09:55:20.866701 --- ParallelTerminationStrategy: PID 26154 died... 09:55:20.886322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26154): Terminated: ok {rc=0} 09:55:20.933464 --- ParallelTerminationStrategy: PID 26157 died... 09:55:20.953193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26157): Terminated: ok {rc=0} 09:55:21.041311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:55:22.191656 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.203767 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:55:22.243134 tst iperf3m4.py: using LAC 27584 09:55:22.370536 tst iperf3m4.py: using RAC 44 09:55:22.498950 tst iperf3m4.py: using CellId 27584 09:55:22.625759 tst iperf3m4.py: using BVCI 27585 09:55:22.746133 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.757386 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.768498 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.779978 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.791351 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.802857 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.814445 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.825882 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:22.837474 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:22.953547 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:23.075973 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:23.191780 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:23.310247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:55:23.530153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:55:23.857410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26159): Launched 09:55:24.139122 run iperf3-srv_10.42.42.10(pid=26160): Launched 09:55:24.261589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:55:24.480838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:55:24.806067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26161): Launched 09:55:25.087799 run iperf3-srv_10.42.42.10(pid=26162): Launched 09:55:25.209943 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:55:25.429625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:55:25.754647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26163): Launched 09:55:26.041997 run iperf3-srv_10.42.42.10(pid=26164): Launched 09:55:26.163286 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:55:26.382997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:55:26.708137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Launched 09:55:26.989453 run iperf3-srv_10.42.42.10(pid=26166): Launched 09:55:27.111193 tst iperf3m4.py:8: start network... 09:55:27.331555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:27.835625 run create_hlr_db(pid=26167): Launched 09:55:27.959095 bus /gobi_6: Setting Powered False 09:55:29.023811 run create_hlr_db(pid=26167): Terminated: ok {rc=0} 09:55:29.457315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26169): Launched 09:55:29.758393 run osmo-hlr_10.42.42.2(pid=26170): Launched 09:55:29.873499 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:30.394780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26172): Launched 09:55:30.695943 run osmo-stp_10.42.42.5(pid=26173): Launched 09:55:30.810859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:55:31.429914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26175): Launched 09:55:31.551672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:55:31.822170 run patchelf(pid=26176): Launched 09:55:32.003792 run osmo-stp_10.42.42.5(pid=26173): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26173)] 09:55:32.135011 run osmo-stp_10.42.42.5(pid=26173): stdout: | (launched: 2022-12-10_09:55:30.640939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:32.267090 run osmo-stp_10.42.42.5(pid=26173): stderr: | 20221210095530810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095530810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095530811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095530811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095530812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095530812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095530812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:32.399147 run osmo-stp_10.42.42.5(pid=26173): stdout: | (launched: 2022-12-10_09:55:30.640939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:32.522892 run osmo-stp_10.42.42.5(pid=26173): stderr: | 20221210095530810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095530810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095530811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095530811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095530812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095530812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095530812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:32.669601 run patchelf(pid=26176): Terminating (SIGINT) 09:55:32.839969 run patchelf(pid=26176): Terminated: ok {rc=0} 09:55:32.962708 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26173): Process ended prematurely: osmo-stp_10.42.42.5(pid=26173) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26173)] [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 09:55:32.972183 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:55:32.999740 run osmo-hlr_10.42.42.2(pid=26170): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26170)] 09:55:33.047541 run osmo-hlr_10.42.42.2(pid=26170): stdout: | (launched: 2022-12-10_09:55:29.703948) 09:55:33.096788 run osmo-hlr_10.42.42.2(pid=26170): stderr: | 20221210095529881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095529882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095529882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095529882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095529882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095529882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095529896 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095529906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095529906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095529907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:33.146636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26159): Terminating (SIGTERM) 09:55:33.186411 run iperf3-srv_10.42.42.10(pid=26160): Terminating (SIGTERM) 09:55:33.226680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26161): Terminating (SIGTERM) 09:55:33.266438 run iperf3-srv_10.42.42.10(pid=26162): Terminating (SIGTERM) 09:55:33.305979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26163): Terminating (SIGTERM) 09:55:33.345591 run iperf3-srv_10.42.42.10(pid=26164): Terminating (SIGTERM) 09:55:33.385107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Terminating (SIGTERM) 09:55:33.424714 run iperf3-srv_10.42.42.10(pid=26166): Terminating (SIGTERM) 09:55:33.464129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26169): Terminating (SIGTERM) 09:55:33.503976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26172): Terminating (SIGTERM) 09:55:33.543584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26175): Terminating (SIGTERM) 09:55:33.583383 --- ParallelTerminationStrategy: PID 26159 died... 09:55:33.602350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26159): Terminated: ok {rc=0} 09:55:33.646444 --- ParallelTerminationStrategy: PID 26160 died... 09:55:33.664935 run iperf3-srv_10.42.42.10(pid=26160): Terminated {rc=256} 09:55:33.708837 --- ParallelTerminationStrategy: PID 26161 died... 09:55:33.727795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26161): Terminated: ok {rc=0} 09:55:33.772210 --- ParallelTerminationStrategy: PID 26162 died... 09:55:33.790850 run iperf3-srv_10.42.42.10(pid=26162): Terminated {rc=256} 09:55:33.835380 --- ParallelTerminationStrategy: PID 26163 died... 09:55:33.854131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26163): Terminated: ok {rc=0} 09:55:33.898337 --- ParallelTerminationStrategy: PID 26164 died... 09:55:33.917088 run iperf3-srv_10.42.42.10(pid=26164): Terminated {rc=256} 09:55:33.961188 --- ParallelTerminationStrategy: PID 26165 died... 09:55:33.979859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26165): Terminated: ok {rc=0} 09:55:34.023853 --- ParallelTerminationStrategy: PID 26166 died... 09:55:34.042456 run iperf3-srv_10.42.42.10(pid=26166): Terminated {rc=256} 09:55:34.086302 --- ParallelTerminationStrategy: PID 26169 died... 09:55:34.105082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26169): Terminated: ok {rc=0} 09:55:34.149261 --- ParallelTerminationStrategy: PID 26172 died... 09:55:34.168011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26172): Terminated: ok {rc=0} 09:55:34.212167 --- ParallelTerminationStrategy: PID 26175 died... 09:55:34.230890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26175): Terminated: ok {rc=0} 09:55:34.315707 bus /gobi_4: Setting Powered False 09:55:35.414643 bus /gobi_4: Setting Powered False 09:55:36.530970 bus /gobi_1: Setting Powered False 09:55:37.628465 bus /gobi_1: Setting Powered False 09:55:38.740798 bus /gobi_0: Setting Powered False 09:55:39.838721 bus /gobi_0: Setting Powered False 09:55:40.954738 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 09:55:42.054685 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.066283 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:55:42.104308 tst ping.py: using LAC 27585 09:55:42.222672 tst ping.py: using RAC 45 09:55:42.343234 tst ping.py: using CellId 27585 09:55:42.460602 tst ping.py: using BVCI 27586 09:55:42.568329 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.579236 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.590084 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.600625 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.611167 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.621737 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.632395 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:42.643009 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:42.761884 tst ping.py:19: start network... 09:55:42.978593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:43.471900 run create_hlr_db(pid=26177): Launched 09:55:43.593816 bus /gobi_6: Setting Powered False 09:55:44.656717 run create_hlr_db(pid=26177): Terminated: ok {rc=0} 09:55:45.083958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26179): Launched 09:55:45.379119 run osmo-hlr_10.42.42.2(pid=26180): Launched 09:55:45.491542 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:46.034099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26182): Launched 09:55:46.351104 run osmo-stp_10.42.42.5(pid=26183): Launched 09:55:46.533190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:55:47.442060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26185): Launched 09:55:47.564267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:55:47.832142 run patchelf(pid=26186): Launched 09:55:48.008602 run osmo-stp_10.42.42.5(pid=26183): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26183)] 09:55:48.143327 run osmo-stp_10.42.42.5(pid=26183): stdout: | (launched: 2022-12-10_09:55:46.288433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:48.279869 run osmo-stp_10.42.42.5(pid=26183): stderr: | 20221210095546607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095546607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095546607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095546608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095546610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095546610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095546610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:48.416451 run osmo-stp_10.42.42.5(pid=26183): stdout: | (launched: 2022-12-10_09:55:46.288433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:48.546923 run osmo-stp_10.42.42.5(pid=26183): stderr: | 20221210095546607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095546607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095546607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095546608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095546610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095546610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095546610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:48.701280 run patchelf(pid=26186): Terminating (SIGINT) 09:55:48.879477 run patchelf(pid=26186): Terminated: ok {rc=0} 09:55:49.008065 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26183): Process ended prematurely: osmo-stp_10.42.42.5(pid=26183) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26183)] [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 09:55:49.017567 tst ping.py:22: Test FAILED (7.0 sec) 09:55:49.046153 run osmo-hlr_10.42.42.2(pid=26180): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26180)] 09:55:49.096241 run osmo-hlr_10.42.42.2(pid=26180): stdout: | (launched: 2022-12-10_09:55:45.325517) 09:55:49.148470 run osmo-hlr_10.42.42.2(pid=26180): stderr: | 20221210095545499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095545499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095545499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095545499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095545499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095545499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095545511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095545519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095545520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095545520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:49.200938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26179): Terminating (SIGTERM) 09:55:49.243031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26182): Terminating (SIGTERM) 09:55:49.285304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26185): Terminating (SIGTERM) 09:55:49.327721 --- ParallelTerminationStrategy: PID 26179 died... 09:55:49.347968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26179): Terminated: ok {rc=0} 09:55:49.395154 --- ParallelTerminationStrategy: PID 26182 died... 09:55:49.414790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26182): Terminated: ok {rc=0} 09:55:49.461391 --- ParallelTerminationStrategy: PID 26185 died... 09:55:49.481100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26185): Terminated: ok {rc=0} 09:55:49.569378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:55:50.654587 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:50.666204 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:55:50.704565 tst ping_idle_ping.py: using LAC 27586 09:55:50.822510 tst ping_idle_ping.py: using RAC 46 09:55:50.943389 tst ping_idle_ping.py: using CellId 27586 09:55:51.061778 tst ping_idle_ping.py: using BVCI 27587 09:55:51.181293 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:51.192702 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:51.204075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:51.215700 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:51.228109 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:51.239661 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:51.251625 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:55:51.263079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:55:51.384663 tst ping_idle_ping.py:24: start network... 09:55:51.585801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:55:52.046053 run create_hlr_db(pid=26187): Launched 09:55:52.168046 bus /gobi_6: Setting Powered False 09:55:53.228290 run create_hlr_db(pid=26187): Terminated: ok {rc=0} 09:55:53.645036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26189): Launched 09:55:53.942060 run osmo-hlr_10.42.42.2(pid=26190): Launched 09:55:54.054932 run osmo-stp_10.42.42.5: Starting osmo-stp 09:55:54.570461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26192): Launched 09:55:54.866490 run osmo-stp_10.42.42.5(pid=26193): Launched 09:55:54.979712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:55:55.493573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26195): Launched 09:55:55.607738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:55:55.858423 run patchelf(pid=26196): Launched 09:55:56.023191 run osmo-stp_10.42.42.5(pid=26193): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26193)] 09:55:56.149154 run osmo-stp_10.42.42.5(pid=26193): stdout: | (launched: 2022-12-10_09:55:54.812433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:56.276333 run osmo-stp_10.42.42.5(pid=26193): stderr: | 20221210095554982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095554982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095554982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095554983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095554983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095554983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095554983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:56.403818 run osmo-stp_10.42.42.5(pid=26193): stdout: | (launched: 2022-12-10_09:55:54.812433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:55:56.525353 run osmo-stp_10.42.42.5(pid=26193): stderr: | 20221210095554982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095554982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095554982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095554983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095554983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095554983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095554983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:55:56.670298 run patchelf(pid=26196): Terminating (SIGINT) 09:55:56.837517 run patchelf(pid=26196): Terminated: ok {rc=0} 09:55:56.958005 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26193): Process ended prematurely: osmo-stp_10.42.42.5(pid=26193) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26193)] [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 09:55:56.966730 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 09:55:56.992773 run osmo-hlr_10.42.42.2(pid=26190): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26190)] 09:55:57.040002 run osmo-hlr_10.42.42.2(pid=26190): stdout: | (launched: 2022-12-10_09:55:53.888309) 09:55:57.088673 run osmo-hlr_10.42.42.2(pid=26190): stderr: | 20221210095554064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095554064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095554064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095554064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095554064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095554064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095554076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095554085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095554085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095554085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:55:57.139303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26189): Terminating (SIGTERM) 09:55:57.178601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26192): Terminating (SIGTERM) 09:55:57.218042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26195): Terminating (SIGTERM) 09:55:57.257882 --- ParallelTerminationStrategy: PID 26189 died... 09:55:57.276843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26189): Terminated: ok {rc=0} 09:55:57.320918 --- ParallelTerminationStrategy: PID 26192 died... 09:55:57.339343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26192): Terminated: ok {rc=0} 09:55:57.383087 --- ParallelTerminationStrategy: PID 26195 died... 09:55:57.401591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26195): Terminated: ok {rc=0} 09:55:57.484639 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:55:58.768218 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:55:58.774045 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:55:58.794618 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:55:58.833038 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:55:58.919579 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:55:58.940190 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:55:58.978393 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:55:59.574210 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:55:59.622402 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:55:59.633121 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:55:59.686713 tst cs_paging_gprs_active.py: using LAC 27587 09:55:59.804520 tst cs_paging_gprs_active.py: using RAC 47 09:55:59.921019 tst cs_paging_gprs_active.py: using CellId 27587 09:56:00.037763 tst cs_paging_gprs_active.py: using BVCI 27588 09:56:00.147710 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.158649 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.169327 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.179876 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.190396 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.200868 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.211566 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.222431 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:00.233216 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:00.352247 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:00.471922 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:56:00.692574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:01.053792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26201): Launched 09:56:01.350864 run iperf3-srv_10.42.42.10(pid=26202): Launched 09:56:01.488511 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:56:01.713923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:02.073177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Launched 09:56:02.344673 run iperf3-srv_10.42.42.10(pid=26204): Launched 09:56:02.458528 tst cs_paging_gprs_active.py:38: start network... 09:56:02.662459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:03.130644 run create_hlr_db(pid=26205): Launched 09:56:03.253408 bus /gobi_6: Setting Powered False 09:56:04.314165 run create_hlr_db(pid=26205): Terminated: ok {rc=0} 09:56:04.757725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26207): Launched 09:56:05.082112 run osmo-hlr_10.42.42.2(pid=26208): Launched 09:56:05.205910 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:05.769159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26210): Launched 09:56:06.091964 run osmo-stp_10.42.42.5(pid=26211): Launched 09:56:06.215405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:06.774971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26213): Launched 09:56:06.896074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:07.152111 run patchelf(pid=26214): Launched 09:56:07.320823 run osmo-stp_10.42.42.5(pid=26211): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26211)] 09:56:07.449701 run osmo-stp_10.42.42.5(pid=26211): stdout: | (launched: 2022-12-10_09:56:06.033899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:07.579863 run osmo-stp_10.42.42.5(pid=26211): stderr: | 20221210095606226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095606227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095606227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095606227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095606228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095606228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095606228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:07.710290 run osmo-stp_10.42.42.5(pid=26211): stdout: | (launched: 2022-12-10_09:56:06.033899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:07.834539 run osmo-stp_10.42.42.5(pid=26211): stderr: | 20221210095606226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095606227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095606227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095606227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095606228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095606228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095606228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:07.981730 run patchelf(pid=26214): Terminating (SIGINT) 09:56:08.152557 run patchelf(pid=26214): Terminated: ok {rc=0} 09:56:08.276199 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26211): Process ended prematurely: osmo-stp_10.42.42.5(pid=26211) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26211)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:56:08.285498 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:56:08.312630 run osmo-hlr_10.42.42.2(pid=26208): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26208)] 09:56:08.360575 run osmo-hlr_10.42.42.2(pid=26208): stdout: | (launched: 2022-12-10_09:56:05.023946) 09:56:08.409888 run osmo-hlr_10.42.42.2(pid=26208): stderr: | 20221210095605223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095605223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095605223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095605223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095605223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095605223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095605235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095605244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095605244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095605244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:08.459553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26201): Terminating (SIGTERM) 09:56:08.499447 run iperf3-srv_10.42.42.10(pid=26202): Terminating (SIGTERM) 09:56:08.539100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Terminating (SIGTERM) 09:56:08.578875 run iperf3-srv_10.42.42.10(pid=26204): Terminating (SIGTERM) 09:56:08.618685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26207): Terminating (SIGTERM) 09:56:08.658846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26210): Terminating (SIGTERM) 09:56:08.698818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26213): Terminating (SIGTERM) 09:56:08.738713 --- ParallelTerminationStrategy: PID 26201 died... 09:56:08.757713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26201): Terminated: ok {rc=0} 09:56:08.801656 --- ParallelTerminationStrategy: PID 26202 died... 09:56:08.820089 run iperf3-srv_10.42.42.10(pid=26202): Terminated {rc=256} 09:56:08.863808 --- ParallelTerminationStrategy: PID 26203 died... 09:56:08.882453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Terminated: ok {rc=0} 09:56:08.926491 --- ParallelTerminationStrategy: PID 26204 died... 09:56:08.944880 run iperf3-srv_10.42.42.10(pid=26204): Terminated {rc=256} 09:56:08.988600 --- ParallelTerminationStrategy: PID 26207 died... 09:56:09.007212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26207): Terminated: ok {rc=0} 09:56:09.050823 --- ParallelTerminationStrategy: PID 26210 died... 09:56:09.069388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26210): Terminated: ok {rc=0} 09:56:09.113223 --- ParallelTerminationStrategy: PID 26213 died... 09:56:09.131634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26213): Terminated: ok {rc=0} 09:56:09.217257 bus /gobi_0: Setting Powered False 09:56:10.318292 bus /gobi_0: Setting Powered False 09:56:11.434184 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:56:12.581721 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:12.593539 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:56:12.652876 tst iperf3.py: using LAC 27588 09:56:12.774730 tst iperf3.py: using RAC 48 09:56:12.895477 tst iperf3.py: using CellId 27588 09:56:13.016710 tst iperf3.py: using BVCI 27589 09:56:13.127521 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.138522 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.149173 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.159808 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.170342 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.181065 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.191781 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.202312 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:13.213028 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:13.330424 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:56:13.550287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:13.875562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26215): Launched 09:56:14.157902 run iperf3-srv_10.42.42.10(pid=26216): Launched 09:56:14.279677 tst iperf3.py:8: start network... 09:56:14.498905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:14.999450 run create_hlr_db(pid=26217): Launched 09:56:15.123507 bus /gobi_6: Setting Powered False 09:56:16.195466 run create_hlr_db(pid=26217): Terminated: ok {rc=0} 09:56:16.741891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26219): Launched 09:56:17.071113 run osmo-hlr_10.42.42.2(pid=26220): Launched 09:56:17.300843 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:17.834078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26222): Launched 09:56:18.135696 run osmo-stp_10.42.42.5(pid=26223): Launched 09:56:18.250750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:18.772587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26225): Launched 09:56:18.888244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:19.142415 run patchelf(pid=26226): Launched 09:56:19.310457 run osmo-stp_10.42.42.5(pid=26223): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26223)] 09:56:19.438246 run osmo-stp_10.42.42.5(pid=26223): stdout: | (launched: 2022-12-10_09:56:18.080779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:19.567696 run osmo-stp_10.42.42.5(pid=26223): stderr: | 20221210095618253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095618253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095618253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095618254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095618254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095618254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095618254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:19.697170 run osmo-stp_10.42.42.5(pid=26223): stdout: | (launched: 2022-12-10_09:56:18.080779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:19.820824 run osmo-stp_10.42.42.5(pid=26223): stderr: | 20221210095618253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095618253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095618253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095618254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095618254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095618254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095618254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:19.967284 run patchelf(pid=26226): Terminating (SIGINT) 09:56:20.136788 run patchelf(pid=26226): Terminated: ok {rc=0} 09:56:20.259645 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26223): Process ended prematurely: osmo-stp_10.42.42.5(pid=26223) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26223)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 09:56:20.269478 tst iperf3.py:8: Test FAILED (7.7 sec) 09:56:20.296576 run osmo-hlr_10.42.42.2(pid=26220): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26220)] 09:56:20.344209 run osmo-hlr_10.42.42.2(pid=26220): stdout: | (launched: 2022-12-10_09:56:17.007592) 09:56:20.393449 run osmo-hlr_10.42.42.2(pid=26220): stderr: | 20221210095617291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095617291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095617291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095617291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095617291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095617291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095617303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095617316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095617316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095617316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:20.442968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26215): Terminating (SIGTERM) 09:56:20.482598 run iperf3-srv_10.42.42.10(pid=26216): Terminating (SIGTERM) 09:56:20.522224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26219): Terminating (SIGTERM) 09:56:20.561916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26222): Terminating (SIGTERM) 09:56:20.601395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26225): Terminating (SIGTERM) 09:56:20.641184 --- ParallelTerminationStrategy: PID 26215 died... 09:56:20.660203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26215): Terminated: ok {rc=0} 09:56:20.704726 --- ParallelTerminationStrategy: PID 26216 died... 09:56:20.723287 run iperf3-srv_10.42.42.10(pid=26216): Terminated {rc=256} 09:56:20.767498 --- ParallelTerminationStrategy: PID 26219 died... 09:56:20.786108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26219): Terminated: ok {rc=0} 09:56:20.829737 --- ParallelTerminationStrategy: PID 26222 died... 09:56:20.848196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26222): Terminated: ok {rc=0} 09:56:20.891812 --- ParallelTerminationStrategy: PID 26225 died... 09:56:20.910393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26225): Terminated: ok {rc=0} 09:56:20.995642 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:56:22.143463 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.154839 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:56:22.211674 tst iperf3m4.py: using LAC 27589 09:56:22.340653 tst iperf3m4.py: using RAC 49 09:56:22.469362 tst iperf3m4.py: using CellId 27589 09:56:22.595777 tst iperf3m4.py: using BVCI 27590 09:56:22.713909 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.725445 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.736644 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.748035 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.759270 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.770615 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.782152 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.793535 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:22.805109 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:22.920692 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:23.042928 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:23.159747 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:23.281107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:56:23.500359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:23.826238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26227): Launched 09:56:24.108414 run iperf3-srv_10.42.42.10(pid=26228): Launched 09:56:24.229912 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:56:24.449645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:24.774603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26229): Launched 09:56:25.056284 run iperf3-srv_10.42.42.10(pid=26230): Launched 09:56:25.177604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:56:25.396431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:25.720932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26231): Launched 09:56:26.002323 run iperf3-srv_10.42.42.10(pid=26232): Launched 09:56:26.123768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:56:26.343682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:56:26.669236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26233): Launched 09:56:26.951128 run iperf3-srv_10.42.42.10(pid=26234): Launched 09:56:27.072874 tst iperf3m4.py:8: start network... 09:56:27.291713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:27.792642 run create_hlr_db(pid=26235): Launched 09:56:27.915930 bus /gobi_6: Setting Powered False 09:56:28.980621 run create_hlr_db(pid=26235): Terminated: ok {rc=0} 09:56:29.412757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26237): Launched 09:56:29.714426 run osmo-hlr_10.42.42.2(pid=26238): Launched 09:56:29.828169 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:30.347706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26240): Launched 09:56:30.649422 run osmo-stp_10.42.42.5(pid=26241): Launched 09:56:30.764839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:31.371410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26243): Launched 09:56:31.510003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:31.799422 run patchelf(pid=26244): Launched 09:56:32.033589 run osmo-stp_10.42.42.5(pid=26241): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26241)] 09:56:32.182398 run osmo-stp_10.42.42.5(pid=26241): stdout: | (launched: 2022-12-10_09:56:30.594743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:32.312270 run osmo-stp_10.42.42.5(pid=26241): stderr: | 20221210095630765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095630765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095630765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095630765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095630766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095630766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095630766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:32.442103 run osmo-stp_10.42.42.5(pid=26241): stdout: | (launched: 2022-12-10_09:56:30.594743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:32.565599 run osmo-stp_10.42.42.5(pid=26241): stderr: | 20221210095630765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095630765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095630765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095630765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095630766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095630766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095630766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:32.712474 run patchelf(pid=26244): Terminating (SIGINT) 09:56:32.883533 run patchelf(pid=26244): Terminated: ok {rc=0} 09:56:33.008366 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26241): Process ended prematurely: osmo-stp_10.42.42.5(pid=26241) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26241)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:56:33.017846 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:56:33.045456 run osmo-hlr_10.42.42.2(pid=26238): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26238)] 09:56:33.093660 run osmo-hlr_10.42.42.2(pid=26238): stdout: | (launched: 2022-12-10_09:56:29.659662) 09:56:33.143282 run osmo-hlr_10.42.42.2(pid=26238): stderr: | 20221210095629836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095629836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095629837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095629837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095629837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095629837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095629852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095629861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095629861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095629861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:33.193225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26227): Terminating (SIGTERM) 09:56:33.233486 run iperf3-srv_10.42.42.10(pid=26228): Terminating (SIGTERM) 09:56:33.273534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26229): Terminating (SIGTERM) 09:56:33.313878 run iperf3-srv_10.42.42.10(pid=26230): Terminating (SIGTERM) 09:56:33.354032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26231): Terminating (SIGTERM) 09:56:33.394699 run iperf3-srv_10.42.42.10(pid=26232): Terminating (SIGTERM) 09:56:33.434739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26233): Terminating (SIGTERM) 09:56:33.474898 run iperf3-srv_10.42.42.10(pid=26234): Terminating (SIGTERM) 09:56:33.514873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26237): Terminating (SIGTERM) 09:56:33.554837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26240): Terminating (SIGTERM) 09:56:33.594885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26243): Terminating (SIGTERM) 09:56:33.635068 --- ParallelTerminationStrategy: PID 26227 died... 09:56:33.654175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26227): Terminated: ok {rc=0} 09:56:33.698312 --- ParallelTerminationStrategy: PID 26228 died... 09:56:33.716712 run iperf3-srv_10.42.42.10(pid=26228): Terminated {rc=256} 09:56:33.760795 --- ParallelTerminationStrategy: PID 26229 died... 09:56:33.779532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26229): Terminated: ok {rc=0} 09:56:33.823515 --- ParallelTerminationStrategy: PID 26230 died... 09:56:33.842107 run iperf3-srv_10.42.42.10(pid=26230): Terminated {rc=256} 09:56:33.885945 --- ParallelTerminationStrategy: PID 26231 died... 09:56:33.904571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26231): Terminated: ok {rc=0} 09:56:33.948652 --- ParallelTerminationStrategy: PID 26232 died... 09:56:33.967294 run iperf3-srv_10.42.42.10(pid=26232): Terminated {rc=256} 09:56:34.011278 --- ParallelTerminationStrategy: PID 26233 died... 09:56:34.030021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26233): Terminated: ok {rc=0} 09:56:34.074034 --- ParallelTerminationStrategy: PID 26234 died... 09:56:34.092825 run iperf3-srv_10.42.42.10(pid=26234): Terminated {rc=256} 09:56:34.137023 --- ParallelTerminationStrategy: PID 26237 died... 09:56:34.155867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26237): Terminated: ok {rc=0} 09:56:34.200161 --- ParallelTerminationStrategy: PID 26240 died... 09:56:34.218997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26240): Terminated: ok {rc=0} 09:56:34.263194 --- ParallelTerminationStrategy: PID 26243 died... 09:56:34.281967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26243): Terminated: ok {rc=0} 09:56:34.368053 bus /gobi_4: Setting Powered False 09:56:35.468749 bus /gobi_4: Setting Powered False 09:56:36.582498 bus /gobi_1: Setting Powered False 09:56:37.681198 bus /gobi_1: Setting Powered False 09:56:38.798131 bus /gobi_0: Setting Powered False 09:56:39.897408 bus /gobi_0: Setting Powered False 09:56:41.016837 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:56:42.120904 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.132887 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:56:42.191536 tst ping.py: using LAC 27590 09:56:42.319049 tst ping.py: using RAC 50 09:56:42.446759 tst ping.py: using CellId 27590 09:56:42.571865 tst ping.py: using BVCI 27591 09:56:42.688215 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.699603 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.710790 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.722317 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.733592 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.744841 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.756433 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:42.767771 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:42.884891 tst ping.py:19: start network... 09:56:43.100332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:43.592204 run create_hlr_db(pid=26245): Launched 09:56:43.712311 bus /gobi_6: Setting Powered False 09:56:44.775416 run create_hlr_db(pid=26245): Terminated: ok {rc=0} 09:56:45.219156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26247): Launched 09:56:45.537139 run osmo-hlr_10.42.42.2(pid=26248): Launched 09:56:45.658827 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:46.233307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26250): Launched 09:56:46.623442 run osmo-stp_10.42.42.5(pid=26251): Launched 09:56:46.897983 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:47.483504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26253): Launched 09:56:47.605400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:47.872228 run patchelf(pid=26254): Launched 09:56:48.048562 run osmo-stp_10.42.42.5(pid=26251): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26251)] 09:56:48.183245 run osmo-stp_10.42.42.5(pid=26251): stdout: | (launched: 2022-12-10_09:56:46.557330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:48.320313 run osmo-stp_10.42.42.5(pid=26251): stderr: | 20221210095646781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095646781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095646782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095646782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095646782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095646782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095646783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:48.456651 run osmo-stp_10.42.42.5(pid=26251): stdout: | (launched: 2022-12-10_09:56:46.557330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:48.586771 run osmo-stp_10.42.42.5(pid=26251): stderr: | 20221210095646781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095646781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095646782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095646782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095646782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095646782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095646783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:48.740817 run patchelf(pid=26254): Terminating (SIGINT) 09:56:48.918739 run patchelf(pid=26254): Terminated: ok {rc=0} 09:56:49.047142 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26251): Process ended prematurely: osmo-stp_10.42.42.5(pid=26251) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26251)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 09:56:49.056329 tst ping.py:22: Test FAILED (6.9 sec) 09:56:49.084673 run osmo-hlr_10.42.42.2(pid=26248): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26248)] 09:56:49.134626 run osmo-hlr_10.42.42.2(pid=26248): stdout: | (launched: 2022-12-10_09:56:45.480118) 09:56:49.186204 run osmo-hlr_10.42.42.2(pid=26248): stderr: | 20221210095645677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095645677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095645677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095645677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095645677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095645677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095645689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095645697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095645698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095645698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:49.238227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26247): Terminating (SIGTERM) 09:56:49.280452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26250): Terminating (SIGTERM) 09:56:49.322552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26253): Terminating (SIGTERM) 09:56:49.364727 --- ParallelTerminationStrategy: PID 26247 died... 09:56:49.384637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26247): Terminated: ok {rc=0} 09:56:49.430999 --- ParallelTerminationStrategy: PID 26250 died... 09:56:49.450415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26250): Terminated: ok {rc=0} 09:56:49.496452 --- ParallelTerminationStrategy: PID 26253 died... 09:56:49.515907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26253): Terminated: ok {rc=0} 09:56:49.603147 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:56:50.692793 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:50.705266 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:56:50.765640 tst ping_idle_ping.py: using LAC 27591 09:56:50.891843 tst ping_idle_ping.py: using RAC 51 09:56:51.020855 tst ping_idle_ping.py: using CellId 27591 09:56:51.143843 tst ping_idle_ping.py: using BVCI 27592 09:56:51.259902 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:51.271186 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:51.282804 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:51.294218 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:51.305669 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:51.316626 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:51.328352 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:56:51.339629 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:56:51.454270 tst ping_idle_ping.py:24: start network... 09:56:51.654837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:56:52.118171 run create_hlr_db(pid=26255): Launched 09:56:52.240238 bus /gobi_6: Setting Powered False 09:56:53.300556 run create_hlr_db(pid=26255): Terminated: ok {rc=0} 09:56:53.738767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26257): Launched 09:56:54.057633 run osmo-hlr_10.42.42.2(pid=26258): Launched 09:56:54.180659 run osmo-stp_10.42.42.5: Starting osmo-stp 09:56:54.735485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26260): Launched 09:56:55.054487 run osmo-stp_10.42.42.5(pid=26261): Launched 09:56:55.177114 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:56:55.729240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26263): Launched 09:56:55.851513 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:56:56.119975 run patchelf(pid=26264): Launched 09:56:56.297759 run osmo-stp_10.42.42.5(pid=26261): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26261)] 09:56:56.433596 run osmo-stp_10.42.42.5(pid=26261): stdout: | (launched: 2022-12-10_09:56:54.996838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:56.570864 run osmo-stp_10.42.42.5(pid=26261): stderr: | 20221210095655185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095655185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095655186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095655186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095655188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095655188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095655189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:56.707734 run osmo-stp_10.42.42.5(pid=26261): stdout: | (launched: 2022-12-10_09:56:54.996838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:56:56.838782 run osmo-stp_10.42.42.5(pid=26261): stderr: | 20221210095655185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095655185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095655186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095655186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095655188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095655188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095655189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:56:56.993894 run patchelf(pid=26264): Terminating (SIGINT) 09:56:57.173029 run patchelf(pid=26264): Terminated: ok {rc=0} 09:56:57.302405 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26261): Process ended prematurely: osmo-stp_10.42.42.5(pid=26261) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26261)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:56:57.311740 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:56:57.340313 run osmo-hlr_10.42.42.2(pid=26258): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26258)] 09:56:57.390706 run osmo-hlr_10.42.42.2(pid=26258): stdout: | (launched: 2022-12-10_09:56:54.000217) 09:56:57.443365 run osmo-hlr_10.42.42.2(pid=26258): stderr: | 20221210095654196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095654196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095654196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095654196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095654196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095654196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095654208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095654217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095654217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095654217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:56:57.496924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26257): Terminating (SIGTERM) 09:56:57.539446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26260): Terminating (SIGTERM) 09:56:57.581822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26263): Terminating (SIGTERM) 09:56:57.624614 --- ParallelTerminationStrategy: PID 26257 died... 09:56:57.644663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26257): Terminated: ok {rc=0} 09:56:57.691785 --- ParallelTerminationStrategy: PID 26260 died... 09:56:57.711415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26260): Terminated: ok {rc=0} 09:56:57.758210 --- ParallelTerminationStrategy: PID 26263 died... 09:56:57.777758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26263): Terminated: ok {rc=0} 09:56:57.866581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:56:59.162569 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:56:59.168843 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:56:59.189743 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:56:59.228187 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:56:59.314232 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:56:59.335000 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:56:59.373425 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:56:59.966138 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:57:00.014640 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.025626 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:57:00.082276 tst cs_paging_gprs_active.py: using LAC 27592 09:57:00.202736 tst cs_paging_gprs_active.py: using RAC 52 09:57:00.323245 tst cs_paging_gprs_active.py: using CellId 27592 09:57:00.444066 tst cs_paging_gprs_active.py: using BVCI 27593 09:57:00.553564 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.564385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.575052 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.585814 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.596290 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.606959 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.617767 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.628243 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:00.638930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:00.758586 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:00.883789 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:57:01.111752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:01.455534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26269): Launched 09:57:01.761960 run iperf3-srv_10.42.42.10(pid=26270): Launched 09:57:01.902331 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:57:02.128624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:02.458370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26271): Launched 09:57:02.740411 run iperf3-srv_10.42.42.10(pid=26272): Launched 09:57:02.861891 tst cs_paging_gprs_active.py:38: start network... 09:57:03.081127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:03.581891 run create_hlr_db(pid=26273): Launched 09:57:03.705560 bus /gobi_6: Setting Powered False 09:57:04.769695 run create_hlr_db(pid=26273): Terminated: ok {rc=0} 09:57:05.202321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26275): Launched 09:57:05.503942 run osmo-hlr_10.42.42.2(pid=26276): Launched 09:57:05.619896 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:06.141783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26278): Launched 09:57:06.443011 run osmo-stp_10.42.42.5(pid=26279): Launched 09:57:06.559560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:07.082410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26281): Launched 09:57:07.198485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:07.453334 run patchelf(pid=26282): Launched 09:57:07.622518 run osmo-stp_10.42.42.5(pid=26279): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26279)] 09:57:07.751157 run osmo-stp_10.42.42.5(pid=26279): stdout: | (launched: 2022-12-10_09:57:06.388110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:07.881157 run osmo-stp_10.42.42.5(pid=26279): stderr: | 20221210095706556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095706556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095706556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095706557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095706557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095706557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095706557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:08.011135 run osmo-stp_10.42.42.5(pid=26279): stdout: | (launched: 2022-12-10_09:57:06.388110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:08.135581 run osmo-stp_10.42.42.5(pid=26279): stderr: | 20221210095706556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095706556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095706556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095706557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095706557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095706557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095706557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:08.282968 run patchelf(pid=26282): Terminating (SIGINT) 09:57:08.454056 run patchelf(pid=26282): Terminated: ok {rc=0} 09:57:08.577512 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26279): Process ended prematurely: osmo-stp_10.42.42.5(pid=26279) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26279)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:57:08.587352 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:57:08.614536 run osmo-hlr_10.42.42.2(pid=26276): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26276)] 09:57:08.662262 run osmo-hlr_10.42.42.2(pid=26276): stdout: | (launched: 2022-12-10_09:57:05.449373) 09:57:08.711651 run osmo-hlr_10.42.42.2(pid=26276): stderr: | 20221210095705625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095705625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095705625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095705625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095705625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095705625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095705641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095705651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095705651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095705651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:08.761387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26269): Terminating (SIGTERM) 09:57:08.802271 run iperf3-srv_10.42.42.10(pid=26270): Terminating (SIGTERM) 09:57:08.842102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26271): Terminating (SIGTERM) 09:57:08.881878 run iperf3-srv_10.42.42.10(pid=26272): Terminating (SIGTERM) 09:57:08.921385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26275): Terminating (SIGTERM) 09:57:08.961070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26278): Terminating (SIGTERM) 09:57:09.000474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26281): Terminating (SIGTERM) 09:57:09.040232 --- ParallelTerminationStrategy: PID 26269 died... 09:57:09.059307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26269): Terminated: ok {rc=0} 09:57:09.103522 --- ParallelTerminationStrategy: PID 26270 died... 09:57:09.122195 run iperf3-srv_10.42.42.10(pid=26270): Terminated {rc=256} 09:57:09.166483 --- ParallelTerminationStrategy: PID 26271 died... 09:57:09.185199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26271): Terminated: ok {rc=0} 09:57:09.229195 --- ParallelTerminationStrategy: PID 26272 died... 09:57:09.247647 run iperf3-srv_10.42.42.10(pid=26272): Terminated {rc=256} 09:57:09.291873 --- ParallelTerminationStrategy: PID 26275 died... 09:57:09.310698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26275): Terminated: ok {rc=0} 09:57:09.354673 --- ParallelTerminationStrategy: PID 26278 died... 09:57:09.373290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26278): Terminated: ok {rc=0} 09:57:09.417381 --- ParallelTerminationStrategy: PID 26281 died... 09:57:09.436059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26281): Terminated: ok {rc=0} 09:57:09.519592 bus /gobi_0: Setting Powered False 09:57:10.617869 bus /gobi_0: Setting Powered False 09:57:11.734453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:57:12.877184 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:12.888682 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:57:12.951460 tst iperf3.py: using LAC 27593 09:57:13.070419 tst iperf3.py: using RAC 53 09:57:13.189423 tst iperf3.py: using CellId 27593 09:57:13.317985 tst iperf3.py: using BVCI 27594 09:57:13.436387 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.448040 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.459407 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.471595 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.483804 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.495843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.508021 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.520280 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:13.533515 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:13.652251 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:57:13.871876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:14.197758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26283): Launched 09:57:14.481525 run iperf3-srv_10.42.42.10(pid=26284): Launched 09:57:14.603843 tst iperf3.py:8: start network... 09:57:14.824400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:15.329590 run create_hlr_db(pid=26285): Launched 09:57:15.453509 bus /gobi_6: Setting Powered False 09:57:16.534782 run create_hlr_db(pid=26285): Terminated: ok {rc=0} 09:57:17.107815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26287): Launched 09:57:17.440116 run osmo-hlr_10.42.42.2(pid=26288): Launched 09:57:17.557107 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:18.083138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26290): Launched 09:57:18.385726 run osmo-stp_10.42.42.5(pid=26291): Launched 09:57:18.500410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:19.025879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26293): Launched 09:57:19.142971 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:19.400817 run patchelf(pid=26294): Launched 09:57:19.569462 run osmo-stp_10.42.42.5(pid=26291): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26291)] 09:57:19.698263 run osmo-stp_10.42.42.5(pid=26291): stdout: | (launched: 2022-12-10_09:57:18.330564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:19.828841 run osmo-stp_10.42.42.5(pid=26291): stderr: | 20221210095718502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095718502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095718502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095718503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095718503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095718503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095718503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:19.959609 run osmo-stp_10.42.42.5(pid=26291): stdout: | (launched: 2022-12-10_09:57:18.330564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:20.083909 run osmo-stp_10.42.42.5(pid=26291): stderr: | 20221210095718502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095718502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095718502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095718503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095718503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095718503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095718503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:20.231394 run patchelf(pid=26294): Terminating (SIGINT) 09:57:20.402543 run patchelf(pid=26294): Terminated: ok {rc=0} 09:57:20.525976 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26291): Process ended prematurely: osmo-stp_10.42.42.5(pid=26291) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26291)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 09:57:20.535308 tst iperf3.py:8: Test FAILED (7.7 sec) 09:57:20.562338 run osmo-hlr_10.42.42.2(pid=26288): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26288)] 09:57:20.609739 run osmo-hlr_10.42.42.2(pid=26288): stdout: | (launched: 2022-12-10_09:57:17.385556) 09:57:20.659086 run osmo-hlr_10.42.42.2(pid=26288): stderr: | 20221210095717560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095717560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095717560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095717560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095717560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095717560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095717572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095717580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095717580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095717581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:20.708811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26283): Terminating (SIGTERM) 09:57:20.748544 run iperf3-srv_10.42.42.10(pid=26284): Terminating (SIGTERM) 09:57:20.788256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26287): Terminating (SIGTERM) 09:57:20.828201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26290): Terminating (SIGTERM) 09:57:20.867992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26293): Terminating (SIGTERM) 09:57:20.907967 --- ParallelTerminationStrategy: PID 26283 died... 09:57:20.927033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26283): Terminated: ok {rc=0} 09:57:20.971488 --- ParallelTerminationStrategy: PID 26284 died... 09:57:20.990106 run iperf3-srv_10.42.42.10(pid=26284): Terminated {rc=256} 09:57:21.033884 --- ParallelTerminationStrategy: PID 26287 died... 09:57:21.052495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26287): Terminated: ok {rc=0} 09:57:21.097153 --- ParallelTerminationStrategy: PID 26290 died... 09:57:21.115796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26290): Terminated: ok {rc=0} 09:57:21.159890 --- ParallelTerminationStrategy: PID 26293 died... 09:57:21.178722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26293): Terminated: ok {rc=0} 09:57:21.262891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:57:22.411406 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:22.423617 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:57:22.483901 tst iperf3m4.py: using LAC 27594 09:57:22.612246 tst iperf3m4.py: using RAC 54 09:57:22.738548 tst iperf3m4.py: using CellId 27594 09:57:22.866877 tst iperf3m4.py: using BVCI 27595 09:57:22.986499 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:22.997976 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:23.009126 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:23.020568 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:23.031978 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:23.043455 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:23.055048 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:23.066454 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:23.078260 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:23.197049 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:23.314313 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:23.430371 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:23.548825 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:57:23.753290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:24.056683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26295): Launched 09:57:24.321294 run iperf3-srv_10.42.42.10(pid=26296): Launched 09:57:24.435019 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:57:24.637614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:24.940623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26297): Launched 09:57:25.203706 run iperf3-srv_10.42.42.10(pid=26298): Launched 09:57:25.318125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:57:25.520608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:25.824326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26299): Launched 09:57:26.088534 run iperf3-srv_10.42.42.10(pid=26300): Launched 09:57:26.201989 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:57:26.404568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:57:26.707332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26301): Launched 09:57:26.971071 run iperf3-srv_10.42.42.10(pid=26302): Launched 09:57:27.084409 tst iperf3m4.py:8: start network... 09:57:27.287160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:27.756524 run create_hlr_db(pid=26303): Launched 09:57:27.880217 bus /gobi_6: Setting Powered False 09:57:28.941393 run create_hlr_db(pid=26303): Terminated: ok {rc=0} 09:57:29.384493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26305): Launched 09:57:29.706743 run osmo-hlr_10.42.42.2(pid=26306): Launched 09:57:29.829779 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:30.392472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26308): Launched 09:57:30.715470 run osmo-stp_10.42.42.5(pid=26309): Launched 09:57:30.847291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:31.535987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26311): Launched 09:57:31.692781 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:31.988172 run patchelf(pid=26312): Launched 09:57:32.170846 run osmo-stp_10.42.42.5(pid=26309): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26309)] 09:57:32.303676 run osmo-stp_10.42.42.5(pid=26309): stdout: | (launched: 2022-12-10_09:57:30.657277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:32.434603 run osmo-stp_10.42.42.5(pid=26309): stderr: | 20221210095730878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095730878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095730878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095730879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095730879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095730879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095730879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:32.565387 run osmo-stp_10.42.42.5(pid=26309): stdout: | (launched: 2022-12-10_09:57:30.657277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:32.689609 run osmo-stp_10.42.42.5(pid=26309): stderr: | 20221210095730878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095730878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095730878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095730879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095730879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095730879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095730879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:32.837094 run patchelf(pid=26312): Terminating (SIGINT) 09:57:33.007683 run patchelf(pid=26312): Terminated: ok {rc=0} 09:57:33.131486 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26309): Process ended prematurely: osmo-stp_10.42.42.5(pid=26309) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26309)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:57:33.141063 tst iperf3m4.py:8: Test FAILED (10.8 sec) 09:57:33.168572 run osmo-hlr_10.42.42.2(pid=26306): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26306)] 09:57:33.216553 run osmo-hlr_10.42.42.2(pid=26306): stdout: | (launched: 2022-12-10_09:57:29.648494) 09:57:33.266241 run osmo-hlr_10.42.42.2(pid=26306): stderr: | 20221210095729846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095729846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095729846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095729846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095729847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095729847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095729859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095729869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095729869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095729869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:33.316388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26295): Terminating (SIGTERM) 09:57:33.357127 run iperf3-srv_10.42.42.10(pid=26296): Terminating (SIGTERM) 09:57:33.397178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26297): Terminating (SIGTERM) 09:57:33.437748 run iperf3-srv_10.42.42.10(pid=26298): Terminating (SIGTERM) 09:57:33.477779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26299): Terminating (SIGTERM) 09:57:33.517961 run iperf3-srv_10.42.42.10(pid=26300): Terminating (SIGTERM) 09:57:33.558082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26301): Terminating (SIGTERM) 09:57:33.598245 run iperf3-srv_10.42.42.10(pid=26302): Terminating (SIGTERM) 09:57:33.638193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26305): Terminating (SIGTERM) 09:57:33.678311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26308): Terminating (SIGTERM) 09:57:33.718384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26311): Terminating (SIGTERM) 09:57:33.758990 --- ParallelTerminationStrategy: PID 26295 died... 09:57:33.778368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26295): Terminated: ok {rc=0} 09:57:33.822989 --- ParallelTerminationStrategy: PID 26296 died... 09:57:33.841735 run iperf3-srv_10.42.42.10(pid=26296): Terminated {rc=256} 09:57:33.886908 --- ParallelTerminationStrategy: PID 26297 died... 09:57:33.905759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26297): Terminated: ok {rc=0} 09:57:33.950590 --- ParallelTerminationStrategy: PID 26298 died... 09:57:33.969336 run iperf3-srv_10.42.42.10(pid=26298): Terminated {rc=256} 09:57:34.013579 --- ParallelTerminationStrategy: PID 26299 died... 09:57:34.032379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26299): Terminated: ok {rc=0} 09:57:34.076702 --- ParallelTerminationStrategy: PID 26300 died... 09:57:34.095505 run iperf3-srv_10.42.42.10(pid=26300): Terminated {rc=256} 09:57:34.139891 --- ParallelTerminationStrategy: PID 26301 died... 09:57:34.158643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26301): Terminated: ok {rc=0} 09:57:34.203249 --- ParallelTerminationStrategy: PID 26302 died... 09:57:34.222082 run iperf3-srv_10.42.42.10(pid=26302): Terminated {rc=256} 09:57:34.266170 --- ParallelTerminationStrategy: PID 26305 died... 09:57:34.285028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26305): Terminated: ok {rc=0} 09:57:34.329313 --- ParallelTerminationStrategy: PID 26308 died... 09:57:34.348089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26308): Terminated: ok {rc=0} 09:57:34.392612 --- ParallelTerminationStrategy: PID 26311 died... 09:57:34.411404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26311): Terminated: ok {rc=0} 09:57:34.497853 bus /gobi_4: Setting Powered False 09:57:35.598187 bus /gobi_4: Setting Powered False 09:57:36.713867 bus /gobi_1: Setting Powered False 09:57:37.812545 bus /gobi_1: Setting Powered False 09:57:38.927268 bus /gobi_0: Setting Powered False 09:57:40.025487 bus /gobi_0: Setting Powered False 09:57:41.140443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:57:42.244924 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.256834 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:57:42.315533 tst ping.py: using LAC 27595 09:57:42.443006 tst ping.py: using RAC 55 09:57:42.560503 tst ping.py: using CellId 27595 09:57:42.677757 tst ping.py: using BVCI 27596 09:57:42.785702 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.796715 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.807479 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.818167 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.828801 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.839429 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.850251 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:42.860849 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:42.977455 tst ping.py:19: start network... 09:57:43.182963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:43.645091 run create_hlr_db(pid=26317): Launched 09:57:43.765254 bus /gobi_6: Setting Powered False 09:57:44.825560 run create_hlr_db(pid=26317): Terminated: ok {rc=0} 09:57:45.263290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26319): Launched 09:57:45.582689 run osmo-hlr_10.42.42.2(pid=26320): Launched 09:57:45.704380 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:46.263738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26322): Launched 09:57:46.591538 run osmo-stp_10.42.42.5(pid=26323): Launched 09:57:46.844470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:47.465384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26325): Launched 09:57:47.580115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:47.829545 run patchelf(pid=26326): Launched 09:57:47.995043 run osmo-stp_10.42.42.5(pid=26323): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26323)] 09:57:48.121240 run osmo-stp_10.42.42.5(pid=26323): stdout: | (launched: 2022-12-10_09:57:46.520573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:48.248898 run osmo-stp_10.42.42.5(pid=26323): stderr: | 20221210095746783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095746783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095746783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095746784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095746784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095746784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095746784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:48.377213 run osmo-stp_10.42.42.5(pid=26323): stdout: | (launched: 2022-12-10_09:57:46.520573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:48.499775 run osmo-stp_10.42.42.5(pid=26323): stderr: | 20221210095746783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095746783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095746783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095746784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095746784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095746784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095746784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:48.644614 run patchelf(pid=26326): Terminating (SIGINT) 09:57:48.812368 run patchelf(pid=26326): Terminated: ok {rc=0} 09:57:48.933115 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26323): Process ended prematurely: osmo-stp_10.42.42.5(pid=26323) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26323)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 09:57:48.941812 tst ping.py:22: Test FAILED (6.7 sec) 09:57:48.968339 run osmo-hlr_10.42.42.2(pid=26320): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26320)] 09:57:49.015964 run osmo-hlr_10.42.42.2(pid=26320): stdout: | (launched: 2022-12-10_09:57:45.525257) 09:57:49.065317 run osmo-hlr_10.42.42.2(pid=26320): stderr: | 20221210095745723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095745723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095745723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095745723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095745723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095745723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095745739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095745748 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095745749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095745749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:49.115054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26319): Terminating (SIGTERM) 09:57:49.155103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26322): Terminating (SIGTERM) 09:57:49.194976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26325): Terminating (SIGTERM) 09:57:49.235040 --- ParallelTerminationStrategy: PID 26319 died... 09:57:49.254122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26319): Terminated: ok {rc=0} 09:57:49.298273 --- ParallelTerminationStrategy: PID 26322 died... 09:57:49.316644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26322): Terminated: ok {rc=0} 09:57:49.361406 --- ParallelTerminationStrategy: PID 26325 died... 09:57:49.380012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26325): Terminated: ok {rc=0} 09:57:49.466259 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:57:50.555394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:50.567327 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:57:50.626548 tst ping_idle_ping.py: using LAC 27596 09:57:50.744418 tst ping_idle_ping.py: using RAC 56 09:57:50.861035 tst ping_idle_ping.py: using CellId 27596 09:57:50.977671 tst ping_idle_ping.py: using BVCI 27597 09:57:51.085002 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:51.095990 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:51.106700 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:51.117488 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:51.128089 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:51.138920 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:51.149775 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:57:51.160344 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:57:51.277194 tst ping_idle_ping.py:24: start network... 09:57:51.493583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:57:51.990051 run create_hlr_db(pid=26327): Launched 09:57:52.111649 bus /gobi_6: Setting Powered False 09:57:53.174916 run create_hlr_db(pid=26327): Terminated: ok {rc=0} 09:57:53.621660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26329): Launched 09:57:53.941152 run osmo-hlr_10.42.42.2(pid=26330): Launched 09:57:54.063482 run osmo-stp_10.42.42.5: Starting osmo-stp 09:57:54.617456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26332): Launched 09:57:54.937566 run osmo-stp_10.42.42.5(pid=26333): Launched 09:57:55.060829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:57:55.616587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26335): Launched 09:57:55.739128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:57:56.008424 run patchelf(pid=26336): Launched 09:57:56.187164 run osmo-stp_10.42.42.5(pid=26333): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26333)] 09:57:56.324237 run osmo-stp_10.42.42.5(pid=26333): stdout: | (launched: 2022-12-10_09:57:54.879881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:56.462933 run osmo-stp_10.42.42.5(pid=26333): stderr: | 20221210095755072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095755072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095755072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095755073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095755073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095755073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095755073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:56.601698 run osmo-stp_10.42.42.5(pid=26333): stdout: | (launched: 2022-12-10_09:57:54.879881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:57:56.733538 run osmo-stp_10.42.42.5(pid=26333): stderr: | 20221210095755072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095755072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095755072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095755073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095755073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095755073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095755073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:57:56.889939 run patchelf(pid=26336): Terminating (SIGINT) 09:57:57.070567 run patchelf(pid=26336): Terminated: ok {rc=0} 09:57:57.200857 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26333): Process ended prematurely: osmo-stp_10.42.42.5(pid=26333) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26333)] [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:57:57.210425 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:57:57.239033 run osmo-hlr_10.42.42.2(pid=26330): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26330)] 09:57:57.289791 run osmo-hlr_10.42.42.2(pid=26330): stdout: | (launched: 2022-12-10_09:57:53.883815) 09:57:57.343066 run osmo-hlr_10.42.42.2(pid=26330): stderr: | 20221210095754082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095754082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095754082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095754082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095754082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095754082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095754095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095754103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095754103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095754103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:57:57.396456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26329): Terminating (SIGTERM) 09:57:57.438968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26332): Terminating (SIGTERM) 09:57:57.481613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26335): Terminating (SIGTERM) 09:57:57.524554 --- ParallelTerminationStrategy: PID 26329 died... 09:57:57.544794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26329): Terminated: ok {rc=0} 09:57:57.592118 --- ParallelTerminationStrategy: PID 26332 died... 09:57:57.611749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26332): Terminated: ok {rc=0} 09:57:57.659179 --- ParallelTerminationStrategy: PID 26335 died... 09:57:57.678975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26335): Terminated: ok {rc=0} 09:57:57.767289 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:57:59.063213 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:57:59.070585 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:57:59.092450 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:57:59.128402 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:57:59.182231 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:57:59.203760 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:57:59.239648 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:57:59.798901 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:57:59.804309 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:57:59.816037 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:57:59.874312 tst switch_tch_pdch.py: using LAC 27597 09:58:00.000504 tst switch_tch_pdch.py: using RAC 57 09:58:00.128542 tst switch_tch_pdch.py: using CellId 27597 09:58:00.251364 tst switch_tch_pdch.py: using BVCI 27598 09:58:00.367686 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:58:00.379392 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:58:00.390852 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:58:00.402569 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:58:00.414164 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:58:00.426019 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:58:00.437966 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:58:00.449917 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:58:00.567962 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:58:00.687228 tst switch_tch_pdch.py:51: start network... 09:58:00.920438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:01.403242 run create_hlr_db(pid=26340): Launched 09:58:01.558501 bus /gobi_6: Setting Powered False 09:58:02.618263 run create_hlr_db(pid=26340): Terminated: ok {rc=0} 09:58:03.064575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26342): Launched 09:58:03.383884 run osmo-hlr_10.42.42.2(pid=26343): Launched 09:58:03.505475 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:04.058417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26345): Launched 09:58:04.376407 run osmo-stp_10.42.42.5(pid=26346): Launched 09:58:04.497671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:05.048277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26348): Launched 09:58:05.170882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:05.439708 run patchelf(pid=26349): Launched 09:58:05.617276 run osmo-stp_10.42.42.5(pid=26346): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26346)] 09:58:05.752357 run osmo-stp_10.42.42.5(pid=26346): stdout: | (launched: 2022-12-10_09:58:04.319101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:05.889110 run osmo-stp_10.42.42.5(pid=26346): stderr: | 20221210095804512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095804512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095804512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095804513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095804513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095804513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095804513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:06.026337 run osmo-stp_10.42.42.5(pid=26346): stdout: | (launched: 2022-12-10_09:58:04.319101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:06.156892 run osmo-stp_10.42.42.5(pid=26346): stderr: | 20221210095804512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095804512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095804512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095804513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095804513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095804513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095804513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:06.311450 run patchelf(pid=26349): Terminating (SIGINT) 09:58:06.490606 run patchelf(pid=26349): Terminated: ok {rc=0} 09:58:06.619813 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26346): Process ended prematurely: osmo-stp_10.42.42.5(pid=26346) [trial-2373↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26346)] [trial-2373↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:58:06.629669 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 09:58:06.658416 run osmo-hlr_10.42.42.2(pid=26343): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26343)] 09:58:06.709196 run osmo-hlr_10.42.42.2(pid=26343): stdout: | (launched: 2022-12-10_09:58:03.326498) 09:58:06.761667 run osmo-hlr_10.42.42.2(pid=26343): stderr: | 20221210095803525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095803525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095803525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095803525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095803525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095803526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095803541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095803550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095803551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095803551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:06.814560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26342): Terminating (SIGTERM) 09:58:06.857020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26345): Terminating (SIGTERM) 09:58:06.899457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26348): Terminating (SIGTERM) 09:58:06.942166 --- ParallelTerminationStrategy: PID 26342 died... 09:58:06.962413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26342): Terminated: ok {rc=0} 09:58:07.009508 --- ParallelTerminationStrategy: PID 26345 died... 09:58:07.029462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26345): Terminated: ok {rc=0} 09:58:07.075956 --- ParallelTerminationStrategy: PID 26348 died... 09:58:07.095531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26348): Terminated: ok {rc=0} 09:58:07.183107 bus /gobi_0: Setting Powered False 09:58:08.281222 bus /gobi_0: Setting Powered False 09:58:09.397079 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:58:10.635406 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:10.641761 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:58:10.663716 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:58:10.699696 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:58:10.754233 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:58:10.775449 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:58:10.811300 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:58:11.367710 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:58:11.372930 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:11.384522 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:58:11.442665 tst switch_tch_pdch.py: using LAC 27598 09:58:11.573447 tst switch_tch_pdch.py: using RAC 58 09:58:11.707232 tst switch_tch_pdch.py: using CellId 27598 09:58:11.826841 tst switch_tch_pdch.py: using BVCI 27599 09:58:11.936703 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:11.947801 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:11.958737 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:11.969622 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:11.980208 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:11.990807 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:12.001620 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:58:12.012230 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:58:12.130477 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:58:12.249334 tst switch_tch_pdch.py:51: start network... 09:58:12.465500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:12.929249 run create_hlr_db(pid=26353): Launched 09:58:13.050899 bus /gobi_6: Setting Powered False 09:58:14.113963 run create_hlr_db(pid=26353): Terminated: ok {rc=0} 09:58:14.516267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Launched 09:58:14.814802 run osmo-hlr_10.42.42.2(pid=26356): Launched 09:58:14.928589 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:15.415974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Launched 09:58:15.713070 run osmo-stp_10.42.42.5(pid=26359): Launched 09:58:15.826452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:58:16.465637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26361): Launched 09:58:16.624152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:58:16.928440 run patchelf(pid=26362): Launched 09:58:17.120359 run osmo-stp_10.42.42.5(pid=26359): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] 09:58:17.259153 run osmo-stp_10.42.42.5(pid=26359): stdout: | (launched: 2022-12-10_09:58:15.658996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:17.387007 run osmo-stp_10.42.42.5(pid=26359): stderr: | 20221210095815832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095815832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095815832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095815832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095815844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095815845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095815845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:17.515191 run osmo-stp_10.42.42.5(pid=26359): stdout: | (launched: 2022-12-10_09:58:15.658996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:17.637143 run osmo-stp_10.42.42.5(pid=26359): stderr: | 20221210095815832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095815832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095815832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095815832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095815844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095815845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095815845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:17.782742 run patchelf(pid=26362): Terminating (SIGINT) 09:58:17.950777 run patchelf(pid=26362): Terminated: ok {rc=0} 09:58:18.071534 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26359): Process ended prematurely: osmo-stp_10.42.42.5(pid=26359) [trial-2373↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] [trial-2373↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:58:18.080456 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:58:18.107426 run osmo-hlr_10.42.42.2(pid=26356): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26356)] 09:58:18.155799 run osmo-hlr_10.42.42.2(pid=26356): stdout: | (launched: 2022-12-10_09:58:14.760713) 09:58:18.205945 run osmo-hlr_10.42.42.2(pid=26356): stderr: | 20221210095814937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095814937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095814937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095814937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095814937 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095814937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095814949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095814958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095814958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095814958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:18.256378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Terminating (SIGTERM) 09:58:18.296874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Terminating (SIGTERM) 09:58:18.337378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26361): Terminating (SIGTERM) 09:58:18.377930 --- ParallelTerminationStrategy: PID 26355 died... 09:58:18.397378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26355): Terminated: ok {rc=0} 09:58:18.442030 --- ParallelTerminationStrategy: PID 26358 died... 09:58:18.460941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26358): Terminated: ok {rc=0} 09:58:18.505371 --- ParallelTerminationStrategy: PID 26361 died... 09:58:18.524192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26361): Terminated: ok {rc=0} 09:58:18.610988 bus /gobi_0: Setting Powered False 09:58:19.711741 bus /gobi_0: Setting Powered False 09:58:20.827856 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_sms:oc2g --------------------------------------------------------------------- 09:58:22.074143 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:22.079079 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 09:58:22.101280 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 09:58:22.108532 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 09:58:22.159767 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 09:58:22.180699 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 09:58:22.187978 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 09:58:22.728094 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 09:58:22.733134 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 09:58:22.744373 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 09:58:22.779729 tst mo_mt_sms.py: using LAC 27599 09:58:22.904862 tst mo_mt_sms.py: using RAC 59 09:58:23.028331 tst mo_mt_sms.py: using CellId 27599 09:58:23.151877 tst mo_mt_sms.py: using BVCI 27600 09:58:23.262257 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 09:58:23.379375 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 09:58:23.497429 tst mo_mt_sms.py:9: start nitb and bts... 09:58:23.713227 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:58:24.360897 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26366): Launched 09:58:24.679622 run osmo-nitb_10.42.42.2(pid=26367): Launched 09:58:24.856473 run osmo-nitb_10.42.42.2(pid=26367): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26367)] 09:58:25.000297 run osmo-nitb_10.42.42.2(pid=26367): stdout: | (launched: 2022-12-10_09:58:24.622518) 09:58:25.145617 run osmo-nitb_10.42.42.2(pid=26367): stderr: | (launched: 2022-12-10_09:58:24.669866) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:58:25.290851 run osmo-nitb_10.42.42.2(pid=26367): stdout: | (launched: 2022-12-10_09:58:24.622518) 09:58:25.430360 run osmo-nitb_10.42.42.2(pid=26367): stderr: | (launched: 2022-12-10_09:58:24.669866) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26367): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26367) [trial-2373↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26367)] 09:58:25.799967 tst osmo-nitb_10.42.42.2(pid=26367): stdout: | (launched: 2022-12-10_09:58:24.622518) 09:58:25.929169 tst osmo-nitb_10.42.42.2(pid=26367): stderr: | (launched: 2022-12-10_09:58:24.669866) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:58:26.081413 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26367): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26367) [trial-2373↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26367)] [trial-2373↪nitb_sms:oc2g↪mo_mt_sms.py:11] 09:58:26.090602 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:58:26.097831 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26366): Terminating (SIGTERM) 09:58:26.309546 --- ParallelTerminationStrategy: PID 26366 died... 09:58:26.332008 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26366): Terminated: ok {rc=0} 09:58:26.420234 bus /sierra_3: Setting Powered False 09:58:27.517981 bus /sierra_3: Setting Powered False 09:58:28.635210 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:oc2g --------------------------------------------------------------------- 09:58:29.817338 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:29.821202 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 09:58:29.846400 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 09:58:29.874985 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 09:58:29.933590 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 09:58:29.955563 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 09:58:29.983639 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 09:58:30.523505 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:oc2g mo_mt_sms.py ---------------------------------------------- 09:58:30.528865 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 09:58:30.539919 tst sms:oc2g: Using 1 x bts (candidates: 1) 09:58:30.574946 tst mo_mt_sms.py: using LAC 27600 09:58:30.697533 tst mo_mt_sms.py: using RAC 60 09:58:30.813925 tst mo_mt_sms.py: using CellId 27600 09:58:30.932198 tst mo_mt_sms.py: using BVCI 27601 09:58:31.095752 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 09:58:31.111652 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 09:58:31.128697 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 09:58:31.144317 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 09:58:31.154892 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 09:58:31.165777 tst sms:oc2g: Using 1 x modem (candidates: 2) 09:58:31.276699 tst sms:oc2g: Using 1 x modem (candidates: 2) 09:58:31.425049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:32.009208 run create_hlr_db(pid=26371): Launched 09:58:32.157232 bus /sierra_2: Setting Powered False 09:58:33.217300 run create_hlr_db(pid=26371): Terminated: ok {rc=0} 09:58:33.654345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26373): Launched 09:58:33.972523 run osmo-hlr_10.42.42.2(pid=26374): Launched 09:58:34.094777 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:34.641723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26376): Launched 09:58:34.959483 run osmo-stp_10.42.42.5(pid=26377): Launched 09:58:35.080179 run osmo-msc_10.42.42.6: Starting osmo-msc 09:58:35.655963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26379): Launched 09:58:35.975259 run osmo-msc_10.42.42.6(pid=26380): Launched 09:58:36.152088 run osmo-stp_10.42.42.5(pid=26377): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26377)] 09:58:36.287065 run osmo-stp_10.42.42.5(pid=26377): stdout: | (launched: 2022-12-10_09:58:34.901826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:36.422433 run osmo-stp_10.42.42.5(pid=26377): stderr: | 20221210095835096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095835096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095835097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095835097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095835098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095835098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095835098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:36.556866 run osmo-stp_10.42.42.5(pid=26377): stdout: | (launched: 2022-12-10_09:58:34.901826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:36.683800 run osmo-stp_10.42.42.5(pid=26377): stderr: | 20221210095835096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095835096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095835097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095835097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095835098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095835098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095835098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:36.835693 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26377): Process ended prematurely: osmo-stp_10.42.42.5(pid=26377) [trial-2373↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26377)] [trial-2373↪sms:oc2g↪mo_mt_sms.py:16] 09:58:36.844647 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 09:58:36.872712 run osmo-hlr_10.42.42.2(pid=26374): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26374)] 09:58:36.923165 run osmo-hlr_10.42.42.2(pid=26374): stdout: | (launched: 2022-12-10_09:58:33.915633) 09:58:36.975570 run osmo-hlr_10.42.42.2(pid=26374): stderr: | 20221210095834111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095834111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095834111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095834111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095834111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095834112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095834159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095834169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095834170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095834170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:37.048414 run osmo-msc_10.42.42.6(pid=26380): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26380)] 09:58:37.098935 run osmo-msc_10.42.42.6(pid=26380): stdout: | (launched: 2022-12-10_09:58:35.917247) 09:58:37.151004 run osmo-msc_10.42.42.6(pid=26380): stderr: | 20221210095836242 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095836242 DLGLOBAL DEBUG validating counter group 0x7f0d77074c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095836242 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095836242 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095836242 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095836242 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095836246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095836246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095836247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095836247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:58:37.203445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26373): Terminating (SIGTERM) 09:58:37.245774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26376): Terminating (SIGTERM) 09:58:37.287984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26379): Terminating (SIGTERM) 09:58:37.330756 --- ParallelTerminationStrategy: PID 26373 died... 09:58:37.350974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26373): Terminated: ok {rc=0} 09:58:37.398158 --- ParallelTerminationStrategy: PID 26376 died... 09:58:37.417799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26376): Terminated: ok {rc=0} 09:58:37.464604 --- ParallelTerminationStrategy: PID 26379 died... 09:58:37.484201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26379): Terminated: ok {rc=0} 09:58:37.572690 bus /sierra_3: Setting Powered False 09:58:38.671884 bus /sierra_3: Setting Powered False 09:58:39.787472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:oc2g --------------------------------------------------------------------- 09:58:41.005518 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:41.009013 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 09:58:41.029370 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 09:58:41.036038 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 09:58:41.069871 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 09:58:41.091202 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 09:58:41.098735 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 09:58:41.617860 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 09:58:41.624789 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 09:58:41.637004 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 09:58:41.674335 tst assert_extension.py: using LAC 27601 09:58:41.791442 tst assert_extension.py: using RAC 61 09:58:41.908636 tst assert_extension.py: using CellId 27601 09:58:42.025511 tst assert_extension.py: using BVCI 27602 09:58:42.132493 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 09:58:42.248337 tst assert_extension.py:10: start nitb and bts... 09:58:42.464460 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:58:43.111590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26385): Launched 09:58:43.430700 run osmo-nitb_10.42.42.2(pid=26386): Launched 09:58:43.607779 run osmo-nitb_10.42.42.2(pid=26386): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26386)] 09:58:43.751249 run osmo-nitb_10.42.42.2(pid=26386): stdout: | (launched: 2022-12-10_09:58:43.373257) 09:58:43.896355 run osmo-nitb_10.42.42.2(pid=26386): stderr: | (launched: 2022-12-10_09:58:43.420622) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:58:44.041499 run osmo-nitb_10.42.42.2(pid=26386): stdout: | (launched: 2022-12-10_09:58:43.373257) 09:58:44.180023 run osmo-nitb_10.42.42.2(pid=26386): stderr: | (launched: 2022-12-10_09:58:43.420622) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26386): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26386) [trial-2373↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26386)] 09:58:44.551208 tst osmo-nitb_10.42.42.2(pid=26386): stdout: | (launched: 2022-12-10_09:58:43.373257) 09:58:44.680314 tst osmo-nitb_10.42.42.2(pid=26386): stderr: | (launched: 2022-12-10_09:58:43.420622) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:58:44.833440 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26386): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26386) [trial-2373↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26386)] [trial-2373↪nitb_ussd:oc2g↪assert_extension.py:12] 09:58:44.842510 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:58:44.849909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26385): Terminating (SIGTERM) 09:58:45.063434 --- ParallelTerminationStrategy: PID 26385 died... 09:58:45.085295 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26385): Terminated: ok {rc=0} 09:58:45.175271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:oc2g --------------------------------------------------------------------- 09:58:46.354636 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:46.362258 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 09:58:46.385014 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 09:58:46.414513 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 09:58:46.453164 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 09:58:46.488225 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 09:58:46.536473 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 09:58:47.045410 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:oc2g assert_extension.py ---------------------------------------------- 09:58:47.050616 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 09:58:47.062263 tst ussd:oc2g: Using 1 x bts (candidates: 1) 09:58:47.099527 tst assert_extension.py: using LAC 27602 09:58:47.257322 tst assert_extension.py: using RAC 62 09:58:47.379809 tst assert_extension.py: using CellId 27602 09:58:47.495390 tst assert_extension.py: using BVCI 27603 09:58:47.603475 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 09:58:47.614083 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 09:58:47.624459 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 09:58:47.634792 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 09:58:47.645181 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 09:58:47.655446 tst ussd:oc2g: Using 1 x modem (candidates: 1) 09:58:47.771687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:48.265211 run create_hlr_db(pid=26390): Launched 09:58:48.387832 bus /sierra_2: Setting Powered False 09:58:49.447526 run create_hlr_db(pid=26390): Terminated: ok {rc=0} 09:58:49.874133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26392): Launched 09:58:50.171667 run osmo-hlr_10.42.42.2(pid=26393): Launched 09:58:50.285215 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:50.802617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26395): Launched 09:58:51.098973 run osmo-stp_10.42.42.5(pid=26396): Launched 09:58:51.214355 run osmo-msc_10.42.42.6: Starting osmo-msc 09:58:51.750944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26398): Launched 09:58:52.048396 run osmo-msc_10.42.42.6(pid=26399): Launched 09:58:52.215304 run osmo-stp_10.42.42.5(pid=26396): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26396)] 09:58:52.341170 run osmo-stp_10.42.42.5(pid=26396): stdout: | (launched: 2022-12-10_09:58:51.044828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:52.466931 run osmo-stp_10.42.42.5(pid=26396): stderr: | 20221210095851212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095851212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095851212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095851212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095851215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095851215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095851215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:52.591038 run osmo-stp_10.42.42.5(pid=26396): stdout: | (launched: 2022-12-10_09:58:51.044828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:58:52.709720 run osmo-stp_10.42.42.5(pid=26396): stderr: | 20221210095851212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095851212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095851212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095851212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095851215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095851215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095851215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:58:52.851903 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26396): Process ended prematurely: osmo-stp_10.42.42.5(pid=26396) [trial-2373↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26396)] [trial-2373↪ussd:oc2g↪assert_extension.py:17] 09:58:52.860031 tst assert_extension.py:17: Test FAILED (5.8 sec) 09:58:52.885881 run osmo-hlr_10.42.42.2(pid=26393): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26393)] 09:58:52.933189 run osmo-hlr_10.42.42.2(pid=26393): stdout: | (launched: 2022-12-10_09:58:50.117276) 09:58:52.981993 run osmo-hlr_10.42.42.2(pid=26393): stderr: | 20221210095850295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095850295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095850295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095850296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095850296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095850296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095850313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095850322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095850322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095850322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:58:53.050009 run osmo-msc_10.42.42.6(pid=26399): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26399)] 09:58:53.097332 run osmo-msc_10.42.42.6(pid=26399): stdout: | (launched: 2022-12-10_09:58:51.994085) 09:58:53.146060 run osmo-msc_10.42.42.6(pid=26399): stderr: | 20221210095852267 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095852267 DLGLOBAL DEBUG validating counter group 0x7fed62447c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095852267 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095852267 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095852267 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095852267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095852269 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095852269 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095852270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095852270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:58:53.195251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26392): Terminating (SIGTERM) 09:58:53.234644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26395): Terminating (SIGTERM) 09:58:53.274017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26398): Terminating (SIGTERM) 09:58:53.313616 --- ParallelTerminationStrategy: PID 26392 died... 09:58:53.332417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26392): Terminated: ok {rc=0} 09:58:53.376704 --- ParallelTerminationStrategy: PID 26395 died... 09:58:53.395284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26395): Terminated: ok {rc=0} 09:58:53.438801 --- ParallelTerminationStrategy: PID 26398 died... 09:58:53.457282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26398): Terminated: ok {rc=0} 09:58:53.540095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:58:54.739175 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:58:54.746389 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:58:54.768607 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:58:54.796467 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:58:54.849279 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:58:54.870216 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:58:54.897714 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:58:55.450007 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:58:55.502874 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:58:55.514409 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:58:55.573068 tst mo_mt_call.py: using LAC 27603 09:58:55.702629 tst mo_mt_call.py: using RAC 63 09:58:55.831255 tst mo_mt_call.py: using CellId 27603 09:58:55.959594 tst mo_mt_call.py: using BVCI 27604 09:58:56.078151 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:58:56.089781 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:58:56.101067 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:58:56.112642 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:58:56.124433 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:58:56.136029 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:58:56.251862 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:58:56.371437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:58:56.874383 run create_hlr_db(pid=26404): Launched 09:58:56.998199 bus /sierra_2: Setting Powered False 09:58:58.058277 run create_hlr_db(pid=26404): Terminated: ok {rc=0} 09:58:58.512633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Launched 09:58:58.837360 run osmo-hlr_10.42.42.2(pid=26408): Launched 09:58:58.961988 run osmo-stp_10.42.42.5: Starting osmo-stp 09:58:59.526922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Launched 09:58:59.851484 run osmo-stp_10.42.42.5(pid=26411): Launched 09:58:59.975951 run osmo-msc_10.42.42.6: Starting osmo-msc 09:59:00.563873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26413): Launched 09:59:00.905685 run osmo-msc_10.42.42.6(pid=26414): Launched 09:59:01.348499 run osmo-stp_10.42.42.5(pid=26411): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] 09:59:01.579835 run osmo-stp_10.42.42.5(pid=26411): stdout: | (launched: 2022-12-10_09:58:59.793106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:01.720261 run osmo-stp_10.42.42.5(pid=26411): stderr: | 20221210095859986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095859986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095859986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095859987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095859987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095859987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095859987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:01.860218 run osmo-stp_10.42.42.5(pid=26411): stdout: | (launched: 2022-12-10_09:58:59.793106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:01.993234 run osmo-stp_10.42.42.5(pid=26411): stderr: | 20221210095859986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095859986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095859986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095859987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095859987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095859987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095859987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:02.152340 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26411): Process ended prematurely: osmo-stp_10.42.42.5(pid=26411) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:59:02.162262 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 09:59:02.192645 run osmo-hlr_10.42.42.2(pid=26408): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26408)] 09:59:02.245083 run osmo-hlr_10.42.42.2(pid=26408): stdout: | (launched: 2022-12-10_09:58:58.779152) 09:59:02.299945 run osmo-hlr_10.42.42.2(pid=26408): stderr: | 20221210095858977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095858977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095858977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095858977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095858977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095858977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095858989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095858999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095858999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095858999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:02.374302 run osmo-msc_10.42.42.6(pid=26414): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26414)] 09:59:02.425658 run osmo-msc_10.42.42.6(pid=26414): stdout: | (launched: 2022-12-10_09:59:00.830985) 09:59:02.478511 run osmo-msc_10.42.42.6(pid=26414): stderr: | 20221210095901294 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095901295 DLGLOBAL DEBUG validating counter group 0x7fdb4dc45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095901295 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095901295 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095901295 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095901296 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095901299 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095901301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095901301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095901301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:59:02.531916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Terminating (SIGTERM) 09:59:02.574723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Terminating (SIGTERM) 09:59:02.617568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26413): Terminating (SIGTERM) 09:59:02.660086 --- ParallelTerminationStrategy: PID 26407 died... 09:59:02.679722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Terminated: ok {rc=0} 09:59:02.726710 --- ParallelTerminationStrategy: PID 26410 died... 09:59:02.746309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Terminated: ok {rc=0} 09:59:02.793144 --- ParallelTerminationStrategy: PID 26413 died... 09:59:02.812774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26413): Terminated: ok {rc=0} 09:59:02.901416 bus /sierra_3: Setting Powered False 09:59:04.001150 bus /sierra_3: Setting Powered False 09:59:05.117350 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:59:06.266705 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:59:06.278897 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:59:06.340442 tst mo_mt_call_osmux.py: using LAC 27604 09:59:06.467386 tst mo_mt_call_osmux.py: using RAC 64 09:59:06.593335 tst mo_mt_call_osmux.py: using CellId 27604 09:59:06.720722 tst mo_mt_call_osmux.py: using BVCI 27605 09:59:06.838678 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:59:06.850277 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:59:06.861847 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:59:06.873442 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:59:06.884910 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:59:06.896554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:59:07.013568 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:59:07.133243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:07.634588 run create_hlr_db(pid=26416): Launched 09:59:07.757472 bus /sierra_2: Setting Powered False 09:59:08.821745 run create_hlr_db(pid=26416): Terminated: ok {rc=0} 09:59:09.254342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26418): Launched 09:59:09.556177 run osmo-hlr_10.42.42.2(pid=26419): Launched 09:59:09.672406 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:10.193433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26421): Launched 09:59:10.496560 run osmo-stp_10.42.42.5(pid=26422): Launched 09:59:10.611986 run osmo-msc_10.42.42.6: Starting osmo-msc 09:59:11.160571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26424): Launched 09:59:11.462676 run osmo-msc_10.42.42.6(pid=26425): Launched 09:59:11.632008 run osmo-stp_10.42.42.5(pid=26422): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26422)] 09:59:11.761118 run osmo-stp_10.42.42.5(pid=26422): stdout: | (launched: 2022-12-10_09:59:10.441708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:11.889119 run osmo-stp_10.42.42.5(pid=26422): stderr: | 20221210095910612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095910612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095910613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095910613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095910613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095910614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095910614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:12.014769 run osmo-stp_10.42.42.5(pid=26422): stdout: | (launched: 2022-12-10_09:59:10.441708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:12.135544 run osmo-stp_10.42.42.5(pid=26422): stderr: | 20221210095910612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095910612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095910613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095910613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095910613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095910614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095910614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:12.279218 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26422): Process ended prematurely: osmo-stp_10.42.42.5(pid=26422) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26422)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:59:12.287878 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:59:12.313985 run osmo-hlr_10.42.42.2(pid=26419): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26419)] 09:59:12.361450 run osmo-hlr_10.42.42.2(pid=26419): stdout: | (launched: 2022-12-10_09:59:09.501212) 09:59:12.410025 run osmo-hlr_10.42.42.2(pid=26419): stderr: | 20221210095909677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095909677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095909677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095909677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095909677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095909677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095909690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095909699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095909699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095909699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:12.478148 run osmo-msc_10.42.42.6(pid=26425): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26425)] 09:59:12.525309 run osmo-msc_10.42.42.6(pid=26425): stdout: | (launched: 2022-12-10_09:59:11.407542) 09:59:12.574079 run osmo-msc_10.42.42.6(pid=26425): stderr: | 20221210095911679 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095911679 DLGLOBAL DEBUG validating counter group 0x7fb361012c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095911679 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095911679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095911680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095911680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095911683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095911683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095911683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095911683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:59:12.623229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26418): Terminating (SIGTERM) 09:59:12.662153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26421): Terminating (SIGTERM) 09:59:12.701204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26424): Terminating (SIGTERM) 09:59:12.740483 --- ParallelTerminationStrategy: PID 26418 died... 09:59:12.759478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26418): Terminated: ok {rc=0} 09:59:12.802824 --- ParallelTerminationStrategy: PID 26421 died... 09:59:12.821255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26421): Terminated: ok {rc=0} 09:59:12.864678 --- ParallelTerminationStrategy: PID 26424 died... 09:59:12.883149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26424): Terminated: ok {rc=0} 09:59:12.966018 bus /sierra_3: Setting Powered False 09:59:14.062644 bus /sierra_3: Setting Powered False 09:59:15.178164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:59:16.416096 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:59:16.423583 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:59:16.458497 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:59:16.487280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:59:16.540791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:59:16.563166 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:59:16.592517 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:59:17.158282 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:59:17.218778 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:17.231992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:59:17.290420 tst mo_mt_call.py: using LAC 27605 09:59:17.412771 tst mo_mt_call.py: using RAC 65 09:59:17.533360 tst mo_mt_call.py: using CellId 27605 09:59:17.652575 tst mo_mt_call.py: using BVCI 27606 09:59:17.764766 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:17.776035 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:17.787036 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:17.798002 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:17.809411 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:17.820420 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:59:17.938824 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:59:18.060558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:18.565160 run create_hlr_db(pid=26430): Launched 09:59:18.690019 bus /sierra_2: Setting Powered False 09:59:19.754490 run create_hlr_db(pid=26430): Terminated: ok {rc=0} 09:59:20.191725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26432): Launched 09:59:20.496399 run osmo-hlr_10.42.42.2(pid=26433): Launched 09:59:20.612691 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:21.135093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26435): Launched 09:59:21.437524 run osmo-stp_10.42.42.5(pid=26436): Launched 09:59:21.553174 run osmo-msc_10.42.42.6: Starting osmo-msc 09:59:22.102401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26438): Launched 09:59:22.405255 run osmo-msc_10.42.42.6(pid=26439): Launched 09:59:22.575581 run osmo-stp_10.42.42.5(pid=26436): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26436)] 09:59:22.703632 run osmo-stp_10.42.42.5(pid=26436): stdout: | (launched: 2022-12-10_09:59:21.382804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:22.832184 run osmo-stp_10.42.42.5(pid=26436): stderr: | 20221210095921553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095921553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095921554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095921554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095921554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095921554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095921555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:22.958979 run osmo-stp_10.42.42.5(pid=26436): stdout: | (launched: 2022-12-10_09:59:21.382804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:23.079987 run osmo-stp_10.42.42.5(pid=26436): stderr: | 20221210095921553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095921553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095921554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095921554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095921554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095921554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095921555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:23.224572 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26436): Process ended prematurely: osmo-stp_10.42.42.5(pid=26436) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26436)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:59:23.233502 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:59:23.260183 run osmo-hlr_10.42.42.2(pid=26433): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26433)] 09:59:23.308252 run osmo-hlr_10.42.42.2(pid=26433): stdout: | (launched: 2022-12-10_09:59:20.441354) 09:59:23.357513 run osmo-hlr_10.42.42.2(pid=26433): stderr: | 20221210095920618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095920618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095920618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095920618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095920618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095920618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095920631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095920640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095920641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095920641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:23.426233 run osmo-msc_10.42.42.6(pid=26439): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26439)] 09:59:23.473871 run osmo-msc_10.42.42.6(pid=26439): stdout: | (launched: 2022-12-10_09:59:22.350353) 09:59:23.522982 run osmo-msc_10.42.42.6(pid=26439): stderr: | 20221210095922621 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095922621 DLGLOBAL DEBUG validating counter group 0x7fe198584c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095922623 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095922623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095922623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095922623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095922626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095922626 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095922626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095922626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:59:23.572704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26432): Terminating (SIGTERM) 09:59:23.611984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26435): Terminating (SIGTERM) 09:59:23.651533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26438): Terminating (SIGTERM) 09:59:23.691322 --- ParallelTerminationStrategy: PID 26432 died... 09:59:23.710285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26432): Terminated: ok {rc=0} 09:59:23.754164 --- ParallelTerminationStrategy: PID 26435 died... 09:59:23.772729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26435): Terminated: ok {rc=0} 09:59:23.816550 --- ParallelTerminationStrategy: PID 26438 died... 09:59:23.835210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26438): Terminated: ok {rc=0} 09:59:23.917926 bus /sierra_3: Setting Powered False 09:59:25.015147 bus /sierra_3: Setting Powered False 09:59:26.131071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:59:27.279950 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:27.292271 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:59:27.351740 tst mo_mt_call_osmux.py: using LAC 27606 09:59:27.472849 tst mo_mt_call_osmux.py: using RAC 66 09:59:27.595730 tst mo_mt_call_osmux.py: using CellId 27606 09:59:27.714710 tst mo_mt_call_osmux.py: using BVCI 27607 09:59:27.827009 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:27.838184 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:27.849157 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:27.860164 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:27.871194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:59:27.882112 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:59:27.999517 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:59:28.122785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:28.629651 run create_hlr_db(pid=26441): Launched 09:59:28.763394 bus /sierra_2: Setting Powered False 09:59:29.823774 run create_hlr_db(pid=26441): Terminated: ok {rc=0} 09:59:30.245337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26443): Launched 09:59:30.549287 run osmo-hlr_10.42.42.2(pid=26444): Launched 09:59:30.665886 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:31.237527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26446): Launched 09:59:31.557282 run osmo-stp_10.42.42.5(pid=26447): Launched 09:59:31.806284 run osmo-msc_10.42.42.6: Starting osmo-msc 09:59:32.510931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26449): Launched 09:59:32.814459 run osmo-msc_10.42.42.6(pid=26450): Launched 09:59:32.983001 run osmo-stp_10.42.42.5(pid=26447): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26447)] 09:59:33.109957 run osmo-stp_10.42.42.5(pid=26447): stdout: | (launched: 2022-12-10_09:59:31.494693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:33.237712 run osmo-stp_10.42.42.5(pid=26447): stderr: | 20221210095931825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095931825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095931825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095931825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095931826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095931826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095931826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:33.364171 run osmo-stp_10.42.42.5(pid=26447): stdout: | (launched: 2022-12-10_09:59:31.494693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:33.484506 run osmo-stp_10.42.42.5(pid=26447): stderr: | 20221210095931825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095931825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095931825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095931825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095931826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095931826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095931826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:33.628500 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26447): Process ended prematurely: osmo-stp_10.42.42.5(pid=26447) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26447)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:59:33.637511 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:59:33.664063 run osmo-hlr_10.42.42.2(pid=26444): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26444)] 09:59:33.711686 run osmo-hlr_10.42.42.2(pid=26444): stdout: | (launched: 2022-12-10_09:59:30.494339) 09:59:33.761161 run osmo-hlr_10.42.42.2(pid=26444): stderr: | 20221210095930670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095930670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095930670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095930670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095930670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095930670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095930694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095930703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095930703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095930703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:33.829827 run osmo-msc_10.42.42.6(pid=26450): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26450)] 09:59:33.877561 run osmo-msc_10.42.42.6(pid=26450): stdout: | (launched: 2022-12-10_09:59:32.759413) 09:59:33.926707 run osmo-msc_10.42.42.6(pid=26450): stderr: | 20221210095933033 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095933033 DLGLOBAL DEBUG validating counter group 0x7f5859f8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095933033 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095933033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095933033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095933034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095933036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095933037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095933037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095933037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:59:33.976156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26443): Terminating (SIGTERM) 09:59:34.015769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26446): Terminating (SIGTERM) 09:59:34.055469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26449): Terminating (SIGTERM) 09:59:34.095668 --- ParallelTerminationStrategy: PID 26443 died... 09:59:34.114981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26443): Terminated: ok {rc=0} 09:59:34.159306 --- ParallelTerminationStrategy: PID 26446 died... 09:59:34.178029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26446): Terminated: ok {rc=0} 09:59:34.222279 --- ParallelTerminationStrategy: PID 26449 died... 09:59:34.241262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26449): Terminated: ok {rc=0} 09:59:34.327132 bus /sierra_3: Setting Powered False 09:59:35.425134 bus /sierra_3: Setting Powered False 09:59:36.539021 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:59:37.773627 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:59:37.779790 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:59:37.800488 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:59:37.827509 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:59:37.878990 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:59:37.900149 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:59:37.927921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:59:38.478913 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:59:38.531203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:38.542580 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:59:38.599821 tst mo_mt_call.py: using LAC 27607 09:59:38.726907 tst mo_mt_call.py: using RAC 67 09:59:38.854329 tst mo_mt_call.py: using CellId 27607 09:59:38.982731 tst mo_mt_call.py: using BVCI 27608 09:59:39.101412 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:39.112873 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:39.124130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:39.135977 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:39.147710 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:39.159262 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:59:39.280809 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:59:39.396307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:39.869461 run create_hlr_db(pid=26455): Launched 09:59:39.994231 bus /sierra_2: Setting Powered False 09:59:41.055207 run create_hlr_db(pid=26455): Terminated: ok {rc=0} 09:59:41.498984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26457): Launched 09:59:41.807016 run osmo-hlr_10.42.42.2(pid=26458): Launched 09:59:41.922387 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:42.480033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26460): Launched 09:59:42.804012 run osmo-stp_10.42.42.5(pid=26461): Launched 09:59:42.927345 run osmo-msc_10.42.42.6: Starting osmo-msc 09:59:43.514428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26463): Launched 09:59:43.839482 run osmo-msc_10.42.42.6(pid=26464): Launched 09:59:44.020358 run osmo-stp_10.42.42.5(pid=26461): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26461)] 09:59:44.157680 run osmo-stp_10.42.42.5(pid=26461): stdout: | (launched: 2022-12-10_09:59:42.745629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:44.295440 run osmo-stp_10.42.42.5(pid=26461): stderr: | 20221210095942938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095942938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095942939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095942939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095942940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095942940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095942940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:44.433255 run osmo-stp_10.42.42.5(pid=26461): stdout: | (launched: 2022-12-10_09:59:42.745629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:44.562747 run osmo-stp_10.42.42.5(pid=26461): stderr: | 20221210095942938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095942938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095942939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095942939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095942940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095942940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095942940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:44.717976 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26461): Process ended prematurely: osmo-stp_10.42.42.5(pid=26461) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26461)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:59:44.727310 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:59:44.755552 run osmo-hlr_10.42.42.2(pid=26458): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26458)] 09:59:44.805603 run osmo-hlr_10.42.42.2(pid=26458): stdout: | (launched: 2022-12-10_09:59:41.752034) 09:59:44.857587 run osmo-hlr_10.42.42.2(pid=26458): stderr: | 20221210095941927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095941927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095941927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095941927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095941927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095941927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095941942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095941950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095941950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095941950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:44.929867 run osmo-msc_10.42.42.6(pid=26464): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26464)] 09:59:44.979940 run osmo-msc_10.42.42.6(pid=26464): stdout: | (launched: 2022-12-10_09:59:43.781171) 09:59:45.031735 run osmo-msc_10.42.42.6(pid=26464): stderr: | 20221210095944102 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095944102 DLGLOBAL DEBUG validating counter group 0x7ff2d80f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095944102 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095944102 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095944102 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095944103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095944104 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095944105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095944105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095944105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:59:45.083846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26457): Terminating (SIGTERM) 09:59:45.125750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26460): Terminating (SIGTERM) 09:59:45.167740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26463): Terminating (SIGTERM) 09:59:45.210132 --- ParallelTerminationStrategy: PID 26457 died... 09:59:45.229967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26457): Terminated: ok {rc=0} 09:59:45.276481 --- ParallelTerminationStrategy: PID 26460 died... 09:59:45.295937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26460): Terminated: ok {rc=0} 09:59:45.342453 --- ParallelTerminationStrategy: PID 26463 died... 09:59:45.361811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26463): Terminated: ok {rc=0} 09:59:45.449282 bus /sierra_3: Setting Powered False 09:59:46.547357 bus /sierra_3: Setting Powered False 09:59:47.665426 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:59:48.812213 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:48.824087 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:59:48.880661 tst mo_mt_call_osmux.py: using LAC 27608 09:59:49.002474 tst mo_mt_call_osmux.py: using RAC 68 09:59:49.125895 tst mo_mt_call_osmux.py: using CellId 27608 09:59:49.245061 tst mo_mt_call_osmux.py: using BVCI 27609 09:59:49.355108 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:49.366246 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:49.377074 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:49.387921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:49.398742 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:59:49.409517 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:59:49.529839 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:59:49.650011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:59:50.155127 run create_hlr_db(pid=26466): Launched 09:59:50.280047 bus /sierra_2: Setting Powered False 09:59:51.345191 run create_hlr_db(pid=26466): Terminated: ok {rc=0} 09:59:51.798210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26468): Launched 09:59:52.124195 run osmo-hlr_10.42.42.2(pid=26469): Launched 09:59:52.249092 run osmo-stp_10.42.42.5: Starting osmo-stp 09:59:52.809527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26471): Launched 09:59:53.134170 run osmo-stp_10.42.42.5(pid=26472): Launched 09:59:53.258189 run osmo-msc_10.42.42.6: Starting osmo-msc 09:59:53.846376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26474): Launched 09:59:54.172192 run osmo-msc_10.42.42.6(pid=26475): Launched 09:59:54.354024 run osmo-stp_10.42.42.5(pid=26472): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26472)] 09:59:54.491546 run osmo-stp_10.42.42.5(pid=26472): stdout: | (launched: 2022-12-10_09:59:53.075543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:54.629930 run osmo-stp_10.42.42.5(pid=26472): stderr: | 20221210095953270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095953270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095953270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095953270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095953271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095953271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095953271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:54.766953 run osmo-stp_10.42.42.5(pid=26472): stdout: | (launched: 2022-12-10_09:59:53.075543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:59:54.896620 run osmo-stp_10.42.42.5(pid=26472): stderr: | 20221210095953270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210095953270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210095953270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210095953270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210095953271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210095953271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210095953271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:59:55.051913 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26472): Process ended prematurely: osmo-stp_10.42.42.5(pid=26472) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26472)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:59:55.061385 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:59:55.089958 run osmo-hlr_10.42.42.2(pid=26469): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26469)] 09:59:55.140228 run osmo-hlr_10.42.42.2(pid=26469): stdout: | (launched: 2022-12-10_09:59:52.065462) 09:59:55.192108 run osmo-hlr_10.42.42.2(pid=26469): stderr: | 20221210095952266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210095952266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210095952266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210095952266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210095952266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210095952266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210095952278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210095952286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210095952286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210095952286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:59:55.264205 run osmo-msc_10.42.42.6(pid=26475): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26475)] 09:59:55.314480 run osmo-msc_10.42.42.6(pid=26475): stdout: | (launched: 2022-12-10_09:59:54.113460) 09:59:55.366306 run osmo-msc_10.42.42.6(pid=26475): stderr: | 20221210095954438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210095954438 DLGLOBAL DEBUG validating counter group 0x7f052f3c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210095954438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210095954439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210095954439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210095954439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210095954440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210095954441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210095954442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210095954442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:59:55.419088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26468): Terminating (SIGTERM) 09:59:55.461321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26471): Terminating (SIGTERM) 09:59:55.503340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26474): Terminating (SIGTERM) 09:59:55.545856 --- ParallelTerminationStrategy: PID 26468 died... 09:59:55.565883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26468): Terminated: ok {rc=0} 09:59:55.612519 --- ParallelTerminationStrategy: PID 26471 died... 09:59:55.632097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26471): Terminated: ok {rc=0} 09:59:55.678761 --- ParallelTerminationStrategy: PID 26474 died... 09:59:55.698348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26474): Terminated: ok {rc=0} 09:59:55.786208 bus /sierra_3: Setting Powered False 09:59:56.884660 bus /sierra_3: Setting Powered False 09:59:58.000903 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:59:59.242070 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:59:59.249587 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:59:59.269852 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:59:59.296802 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:59:59.356576 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:59:59.377248 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:59:59.404291 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:59:59.946821 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:59:59.996388 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:00.007928 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:00:00.065045 tst mo_mt_call.py: using LAC 27609 10:00:00.186239 tst mo_mt_call.py: using RAC 69 10:00:00.306844 tst mo_mt_call.py: using CellId 27609 10:00:00.427076 tst mo_mt_call.py: using BVCI 27610 10:00:00.546452 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:00.558059 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:00.569331 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:00.580550 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:00.592018 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:00.603705 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:00:00.718296 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:00:00.849681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:01.355693 run create_hlr_db(pid=26480): Launched 10:00:01.514618 bus /sierra_2: Setting Powered False 10:00:02.575415 run create_hlr_db(pid=26480): Terminated: ok {rc=0} 10:00:03.034211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26485): Launched 10:00:03.358977 run osmo-hlr_10.42.42.2(pid=26486): Launched 10:00:03.483549 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:04.041151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26488): Launched 10:00:04.365828 run osmo-stp_10.42.42.5(pid=26489): Launched 10:00:04.489856 run osmo-msc_10.42.42.6: Starting osmo-msc 10:00:05.075267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26491): Launched 10:00:05.399921 run osmo-msc_10.42.42.6(pid=26492): Launched 10:00:05.581418 run osmo-stp_10.42.42.5(pid=26489): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26489)] 10:00:05.718730 run osmo-stp_10.42.42.5(pid=26489): stdout: | (launched: 2022-12-10_10:00:04.307043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:05.857243 run osmo-stp_10.42.42.5(pid=26489): stderr: | 20221210100004501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100004501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100004501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100004502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100004502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100004502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100004502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:05.994736 run osmo-stp_10.42.42.5(pid=26489): stdout: | (launched: 2022-12-10_10:00:04.307043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:06.124394 run osmo-stp_10.42.42.5(pid=26489): stderr: | 20221210100004501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100004501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100004501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100004502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100004502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100004502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100004502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:06.279654 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26489): Process ended prematurely: osmo-stp_10.42.42.5(pid=26489) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26489)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:00:06.289132 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:00:06.317793 run osmo-hlr_10.42.42.2(pid=26486): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26486)] 10:00:06.368644 run osmo-hlr_10.42.42.2(pid=26486): stdout: | (launched: 2022-12-10_10:00:03.300485) 10:00:06.421618 run osmo-hlr_10.42.42.2(pid=26486): stderr: | 20221210100003501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100003501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100003501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100003501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100003501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100003501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100003514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100003522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100003522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100003522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:06.494980 run osmo-msc_10.42.42.6(pid=26492): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26492)] 10:00:06.545948 run osmo-msc_10.42.42.6(pid=26492): stdout: | (launched: 2022-12-10_10:00:05.341208) 10:00:06.598539 run osmo-msc_10.42.42.6(pid=26492): stderr: | 20221210100005666 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100005666 DLGLOBAL DEBUG validating counter group 0x7fddf3343c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100005666 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100005666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100005666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100005666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100005668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100005668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100005668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100005668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:00:06.651496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26485): Terminating (SIGTERM) 10:00:06.693597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26488): Terminating (SIGTERM) 10:00:06.735853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26491): Terminating (SIGTERM) 10:00:06.778432 --- ParallelTerminationStrategy: PID 26485 died... 10:00:06.798514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26485): Terminated: ok {rc=0} 10:00:06.845466 --- ParallelTerminationStrategy: PID 26488 died... 10:00:06.865036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26488): Terminated: ok {rc=0} 10:00:06.911849 --- ParallelTerminationStrategy: PID 26491 died... 10:00:06.931427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26491): Terminated: ok {rc=0} 10:00:07.019689 bus /sierra_3: Setting Powered False 10:00:08.117407 bus /sierra_3: Setting Powered False 10:00:09.234796 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:00:10.385210 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:10.397154 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:00:10.455618 tst mo_mt_call_osmux.py: using LAC 27610 10:00:10.582314 tst mo_mt_call_osmux.py: using RAC 70 10:00:10.710001 tst mo_mt_call_osmux.py: using CellId 27610 10:00:10.836718 tst mo_mt_call_osmux.py: using BVCI 27611 10:00:10.954674 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:10.966192 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:10.977468 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:10.989062 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:11.000586 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:00:11.012120 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:00:11.127548 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:00:11.246618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:11.718044 run create_hlr_db(pid=26494): Launched 10:00:11.842038 bus /sierra_2: Setting Powered False 10:00:12.903161 run create_hlr_db(pid=26494): Terminated: ok {rc=0} 10:00:13.328013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26496): Launched 10:00:13.633367 run osmo-hlr_10.42.42.2(pid=26497): Launched 10:00:13.748659 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:14.270848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26499): Launched 10:00:14.574386 run osmo-stp_10.42.42.5(pid=26500): Launched 10:00:14.689968 run osmo-msc_10.42.42.6: Starting osmo-msc 10:00:15.238972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26502): Launched 10:00:15.542924 run osmo-msc_10.42.42.6(pid=26503): Launched 10:00:15.711993 run osmo-stp_10.42.42.5(pid=26500): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26500)] 10:00:15.839981 run osmo-stp_10.42.42.5(pid=26500): stdout: | (launched: 2022-12-10_10:00:14.519076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:16.031747 run osmo-stp_10.42.42.5(pid=26500): stderr: | 20221210100014690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100014691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100014691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100014691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100014692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100014692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100014692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:16.161431 run osmo-stp_10.42.42.5(pid=26500): stdout: | (launched: 2022-12-10_10:00:14.519076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:16.284025 run osmo-stp_10.42.42.5(pid=26500): stderr: | 20221210100014690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100014691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100014691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100014691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100014692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100014692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100014692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:16.432401 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26500): Process ended prematurely: osmo-stp_10.42.42.5(pid=26500) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26500)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:00:16.442365 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:00:16.471202 run osmo-hlr_10.42.42.2(pid=26497): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26497)] 10:00:16.521339 run osmo-hlr_10.42.42.2(pid=26497): stdout: | (launched: 2022-12-10_10:00:13.577887) 10:00:16.572483 run osmo-hlr_10.42.42.2(pid=26497): stderr: | 20221210100013753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100013753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100013753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100013753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100013753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100013753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100013768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100013779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100013779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100013779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:16.645295 run osmo-msc_10.42.42.6(pid=26503): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26503)] 10:00:16.694648 run osmo-msc_10.42.42.6(pid=26503): stdout: | (launched: 2022-12-10_10:00:15.487860) 10:00:16.745264 run osmo-msc_10.42.42.6(pid=26503): stderr: | 20221210100015762 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100015762 DLGLOBAL DEBUG validating counter group 0x7f760137dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100015763 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100015763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100015763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100015763 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100015765 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100015765 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100015765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100015765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:00:16.796014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26496): Terminating (SIGTERM) 10:00:16.837152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26499): Terminating (SIGTERM) 10:00:16.877897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26502): Terminating (SIGTERM) 10:00:16.919015 --- ParallelTerminationStrategy: PID 26496 died... 10:00:16.938790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26496): Terminated: ok {rc=0} 10:00:16.984181 --- ParallelTerminationStrategy: PID 26499 died... 10:00:17.003530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26499): Terminated: ok {rc=0} 10:00:17.049623 --- ParallelTerminationStrategy: PID 26502 died... 10:00:17.069432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26502): Terminated: ok {rc=0} 10:00:17.157870 bus /sierra_3: Setting Powered False 10:00:18.261545 bus /sierra_3: Setting Powered False 10:00:19.377566 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:00:20.609661 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:20.615913 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:00:20.636751 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:00:20.663929 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:00:20.715662 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:00:20.736266 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:00:20.762762 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:00:21.312145 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:00:21.360883 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:21.372049 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:00:21.427979 tst mo_mt_call.py: using LAC 27611 10:00:21.560800 tst mo_mt_call.py: using RAC 71 10:00:21.686984 tst mo_mt_call.py: using CellId 27611 10:00:21.813838 tst mo_mt_call.py: using BVCI 27612 10:00:21.932311 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:21.944076 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:21.955566 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:21.967158 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:21.979025 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:21.990875 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:00:22.108893 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:00:22.228104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:22.732476 run create_hlr_db(pid=26508): Launched 10:00:22.856024 bus /sierra_2: Setting Powered False 10:00:23.920411 run create_hlr_db(pid=26508): Terminated: ok {rc=0} 10:00:24.354395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26510): Launched 10:00:24.657235 run osmo-hlr_10.42.42.2(pid=26511): Launched 10:00:24.774028 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:25.296379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26513): Launched 10:00:25.599982 run osmo-stp_10.42.42.5(pid=26514): Launched 10:00:25.715672 run osmo-msc_10.42.42.6: Starting osmo-msc 10:00:26.264171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26516): Launched 10:00:26.567000 run osmo-msc_10.42.42.6(pid=26517): Launched 10:00:26.737385 run osmo-stp_10.42.42.5(pid=26514): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26514)] 10:00:26.865901 run osmo-stp_10.42.42.5(pid=26514): stdout: | (launched: 2022-12-10_10:00:25.544694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:26.994394 run osmo-stp_10.42.42.5(pid=26514): stderr: | 20221210100025717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100025718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100025718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100025718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100025719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100025719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100025719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:27.121242 run osmo-stp_10.42.42.5(pid=26514): stdout: | (launched: 2022-12-10_10:00:25.544694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:27.241587 run osmo-stp_10.42.42.5(pid=26514): stderr: | 20221210100025717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100025718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100025718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100025718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100025719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100025719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100025719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:27.385959 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26514): Process ended prematurely: osmo-stp_10.42.42.5(pid=26514) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26514)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:00:27.394621 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:00:27.420894 run osmo-hlr_10.42.42.2(pid=26511): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26511)] 10:00:27.468549 run osmo-hlr_10.42.42.2(pid=26511): stdout: | (launched: 2022-12-10_10:00:24.602115) 10:00:27.517616 run osmo-hlr_10.42.42.2(pid=26511): stderr: | 20221210100024776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100024776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100024776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100024776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100024776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100024776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100024790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100024799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100024799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100024799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:27.585799 run osmo-msc_10.42.42.6(pid=26517): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26517)] 10:00:27.633118 run osmo-msc_10.42.42.6(pid=26517): stdout: | (launched: 2022-12-10_10:00:26.512040) 10:00:27.681575 run osmo-msc_10.42.42.6(pid=26517): stderr: | 20221210100026783 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100026783 DLGLOBAL DEBUG validating counter group 0x7f9b71c6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100026783 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100026783 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100026783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100026783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100026787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100026788 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100026788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100026788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:00:27.730610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26510): Terminating (SIGTERM) 10:00:27.769972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26513): Terminating (SIGTERM) 10:00:27.809432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26516): Terminating (SIGTERM) 10:00:27.849239 --- ParallelTerminationStrategy: PID 26510 died... 10:00:27.868203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26510): Terminated: ok {rc=0} 10:00:27.911956 --- ParallelTerminationStrategy: PID 26513 died... 10:00:27.930665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26513): Terminated: ok {rc=0} 10:00:27.974398 --- ParallelTerminationStrategy: PID 26516 died... 10:00:27.993027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26516): Terminated: ok {rc=0} 10:00:28.076128 bus /sierra_3: Setting Powered False 10:00:29.173342 bus /sierra_3: Setting Powered False 10:00:30.289320 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:00:31.438429 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:31.451610 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:00:31.512345 tst mo_mt_call_osmux.py: using LAC 27612 10:00:31.634861 tst mo_mt_call_osmux.py: using RAC 72 10:00:31.784378 tst mo_mt_call_osmux.py: using CellId 27612 10:00:31.916010 tst mo_mt_call_osmux.py: using BVCI 27613 10:00:32.036016 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:32.047747 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:32.059161 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:32.070590 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:32.082197 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:00:32.093756 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:00:32.209646 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:00:32.329114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:32.799846 run create_hlr_db(pid=26519): Launched 10:00:32.924090 bus /sierra_2: Setting Powered False 10:00:33.985471 run create_hlr_db(pid=26519): Terminated: ok {rc=0} 10:00:34.430459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Launched 10:00:34.756147 run osmo-hlr_10.42.42.2(pid=26522): Launched 10:00:34.881153 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:35.442843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Launched 10:00:35.769286 run osmo-stp_10.42.42.5(pid=26525): Launched 10:00:35.894172 run osmo-msc_10.42.42.6: Starting osmo-msc 10:00:36.484417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26527): Launched 10:00:36.810337 run osmo-msc_10.42.42.6(pid=26528): Launched 10:00:36.991982 run osmo-stp_10.42.42.5(pid=26525): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] 10:00:37.129814 run osmo-stp_10.42.42.5(pid=26525): stdout: | (launched: 2022-12-10_10:00:35.710153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:37.268648 run osmo-stp_10.42.42.5(pid=26525): stderr: | 20221210100035903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100035903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100035903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100035904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100035904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100035904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100035904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:37.406994 run osmo-stp_10.42.42.5(pid=26525): stdout: | (launched: 2022-12-10_10:00:35.710153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:37.537156 run osmo-stp_10.42.42.5(pid=26525): stderr: | 20221210100035903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100035903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100035903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100035904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100035904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100035904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100035904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:37.692726 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26525): Process ended prematurely: osmo-stp_10.42.42.5(pid=26525) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:00:37.702411 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:00:37.731210 run osmo-hlr_10.42.42.2(pid=26522): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26522)] 10:00:37.782225 run osmo-hlr_10.42.42.2(pid=26522): stdout: | (launched: 2022-12-10_10:00:34.697723) 10:00:37.835067 run osmo-hlr_10.42.42.2(pid=26522): stderr: | 20221210100034896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100034896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100034896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100034896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100034896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100034896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100034909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100034917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100034917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100034917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:37.908567 run osmo-msc_10.42.42.6(pid=26528): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26528)] 10:00:37.959506 run osmo-msc_10.42.42.6(pid=26528): stdout: | (launched: 2022-12-10_10:00:36.751542) 10:00:38.012211 run osmo-msc_10.42.42.6(pid=26528): stderr: | 20221210100037074 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100037074 DLGLOBAL DEBUG validating counter group 0x7f0433336c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100037074 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100037075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100037075 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100037075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100037076 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100037077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100037077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100037077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:00:38.065373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Terminating (SIGTERM) 10:00:38.107894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Terminating (SIGTERM) 10:00:38.150328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26527): Terminating (SIGTERM) 10:00:38.193184 --- ParallelTerminationStrategy: PID 26521 died... 10:00:38.213505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Terminated: ok {rc=0} 10:00:38.261356 --- ParallelTerminationStrategy: PID 26524 died... 10:00:38.281153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Terminated: ok {rc=0} 10:00:38.328304 --- ParallelTerminationStrategy: PID 26527 died... 10:00:38.348109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26527): Terminated: ok {rc=0} 10:00:38.436562 bus /sierra_3: Setting Powered False 10:00:39.536178 bus /sierra_3: Setting Powered False 10:00:40.652236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:00:41.899401 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:00:41.906209 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:00:41.927470 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:00:41.955405 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:00:42.006237 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:00:42.027211 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:00:42.054660 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:00:42.612610 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:00:42.665229 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:42.676673 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:00:42.733616 tst mo_mt_call.py: using LAC 27613 10:00:42.852786 tst mo_mt_call.py: using RAC 73 10:00:42.971763 tst mo_mt_call.py: using CellId 27613 10:00:43.090441 tst mo_mt_call.py: using BVCI 27614 10:00:43.200775 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:43.212020 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:43.223015 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:43.233850 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:43.244676 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:43.255546 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:00:43.369414 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:00:43.484596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:43.958042 run create_hlr_db(pid=26534): Launched 10:00:44.082187 bus /sierra_2: Setting Powered False 10:00:45.143296 run create_hlr_db(pid=26534): Terminated: ok {rc=0} 10:00:45.567091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26536): Launched 10:00:45.885825 run osmo-hlr_10.42.42.2(pid=26537): Launched 10:00:46.087946 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:46.765445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26539): Launched 10:00:47.110996 run osmo-stp_10.42.42.5(pid=26540): Launched 10:00:47.306668 run osmo-msc_10.42.42.6: Starting osmo-msc 10:00:47.898176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26542): Launched 10:00:48.223667 run osmo-msc_10.42.42.6(pid=26543): Launched 10:00:48.405296 run osmo-stp_10.42.42.5(pid=26540): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26540)] 10:00:48.542727 run osmo-stp_10.42.42.5(pid=26540): stdout: | (launched: 2022-12-10_10:00:47.040595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:48.681380 run osmo-stp_10.42.42.5(pid=26540): stderr: | 20221210100047324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100047324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100047324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100047324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100047325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100047325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100047325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:48.817793 run osmo-stp_10.42.42.5(pid=26540): stdout: | (launched: 2022-12-10_10:00:47.040595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:48.948160 run osmo-stp_10.42.42.5(pid=26540): stderr: | 20221210100047324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100047324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100047324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100047324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100047325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100047325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100047325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:49.104098 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26540): Process ended prematurely: osmo-stp_10.42.42.5(pid=26540) [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26540)] [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:00:49.113557 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:00:49.141804 run osmo-hlr_10.42.42.2(pid=26537): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26537)] 10:00:49.192461 run osmo-hlr_10.42.42.2(pid=26537): stdout: | (launched: 2022-12-10_10:00:45.815474) 10:00:49.244729 run osmo-hlr_10.42.42.2(pid=26537): stderr: | 20221210100046128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100046128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100046128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100046128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100046128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100046128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100046146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100046158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100046159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100046159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:49.317846 run osmo-msc_10.42.42.6(pid=26543): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26543)] 10:00:49.368352 run osmo-msc_10.42.42.6(pid=26543): stdout: | (launched: 2022-12-10_10:00:48.165060) 10:00:49.420777 run osmo-msc_10.42.42.6(pid=26543): stderr: | 20221210100048489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100048489 DLGLOBAL DEBUG validating counter group 0x7fdfb8f59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100048489 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100048489 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100048490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100048490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100048491 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100048492 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100048492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100048492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:00:49.473612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26536): Terminating (SIGTERM) 10:00:49.515869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26539): Terminating (SIGTERM) 10:00:49.558606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26542): Terminating (SIGTERM) 10:00:49.601487 --- ParallelTerminationStrategy: PID 26536 died... 10:00:49.621590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26536): Terminated: ok {rc=0} 10:00:49.668356 --- ParallelTerminationStrategy: PID 26539 died... 10:00:49.687954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26539): Terminated: ok {rc=0} 10:00:49.734775 --- ParallelTerminationStrategy: PID 26542 died... 10:00:49.754263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26542): Terminated: ok {rc=0} 10:00:49.841065 bus /sierra_3: Setting Powered False 10:00:50.938499 bus /sierra_3: Setting Powered False 10:00:52.054339 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:00:53.200854 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:53.212690 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:00:53.269367 tst mo_mt_call_osmux.py: using LAC 27614 10:00:53.389115 tst mo_mt_call_osmux.py: using RAC 74 10:00:53.510907 tst mo_mt_call_osmux.py: using CellId 27614 10:00:53.632440 tst mo_mt_call_osmux.py: using BVCI 27615 10:00:53.742959 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:53.754157 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:53.765050 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:53.775963 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:53.786797 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:00:53.797798 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:00:53.912574 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:00:54.028262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:00:54.502010 run create_hlr_db(pid=26545): Launched 10:00:54.625262 bus /sierra_2: Setting Powered False 10:00:55.685734 run create_hlr_db(pid=26545): Terminated: ok {rc=0} 10:00:56.130576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26547): Launched 10:00:56.459064 run osmo-hlr_10.42.42.2(pid=26548): Launched 10:00:56.584408 run osmo-stp_10.42.42.5: Starting osmo-stp 10:00:57.146487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26550): Launched 10:00:57.473648 run osmo-stp_10.42.42.5(pid=26551): Launched 10:00:57.599622 run osmo-msc_10.42.42.6: Starting osmo-msc 10:00:58.189393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26553): Launched 10:00:58.516781 run osmo-msc_10.42.42.6(pid=26554): Launched 10:00:58.700062 run osmo-stp_10.42.42.5(pid=26551): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26551)] 10:00:58.838070 run osmo-stp_10.42.42.5(pid=26551): stdout: | (launched: 2022-12-10_10:00:57.414317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:58.977077 run osmo-stp_10.42.42.5(pid=26551): stderr: | 20221210100057606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100057606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100057606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100057607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100057607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100057607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100057607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:59.115150 run osmo-stp_10.42.42.5(pid=26551): stdout: | (launched: 2022-12-10_10:00:57.414317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:00:59.245366 run osmo-stp_10.42.42.5(pid=26551): stderr: | 20221210100057606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100057606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100057606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100057607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100057607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100057607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100057607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:00:59.400323 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26551): Process ended prematurely: osmo-stp_10.42.42.5(pid=26551) [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26551)] [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:00:59.410178 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:00:59.438213 run osmo-hlr_10.42.42.2(pid=26548): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26548)] 10:00:59.489415 run osmo-hlr_10.42.42.2(pid=26548): stdout: | (launched: 2022-12-10_10:00:56.399830) 10:00:59.541804 run osmo-hlr_10.42.42.2(pid=26548): stderr: | 20221210100056598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100056598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100056598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100056598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100056598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100056598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100056610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100056618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100056618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100056618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:00:59.614538 run osmo-msc_10.42.42.6(pid=26554): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26554)] 10:00:59.665206 run osmo-msc_10.42.42.6(pid=26554): stdout: | (launched: 2022-12-10_10:00:58.457855) 10:00:59.717422 run osmo-msc_10.42.42.6(pid=26554): stderr: | 20221210100058779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100058779 DLGLOBAL DEBUG validating counter group 0x7f70a7c12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100058779 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100058780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100058780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100058780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100058782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100058782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100058782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100058782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:00:59.769655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26547): Terminating (SIGTERM) 10:00:59.811668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26550): Terminating (SIGTERM) 10:00:59.853851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26553): Terminating (SIGTERM) 10:00:59.896449 --- ParallelTerminationStrategy: PID 26547 died... 10:00:59.916578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26547): Terminated: ok {rc=0} 10:00:59.963295 --- ParallelTerminationStrategy: PID 26550 died... 10:00:59.982931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26550): Terminated: ok {rc=0} 10:01:00.029520 --- ParallelTerminationStrategy: PID 26553 died... 10:01:00.049048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26553): Terminated: ok {rc=0} 10:01:00.136993 bus /sierra_3: Setting Powered False 10:01:01.234631 bus /sierra_3: Setting Powered False 10:01:02.352500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:01:03.590999 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:01:03.597045 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:01:03.618804 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:01:03.646947 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:01:03.702704 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:01:03.724187 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:01:03.750413 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:01:04.301282 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:01:04.354723 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:04.366226 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:01:04.423571 tst mo_mt_call.py: using LAC 27615 10:01:04.549476 tst mo_mt_call.py: using RAC 75 10:01:04.668613 tst mo_mt_call.py: using CellId 27615 10:01:04.786160 tst mo_mt_call.py: using BVCI 27616 10:01:04.895910 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:04.906889 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:04.917601 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:04.928170 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:04.938810 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:04.949460 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:01:05.069286 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:01:05.187548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:05.694776 run create_hlr_db(pid=26559): Launched 10:01:05.818598 bus /sierra_2: Setting Powered False 10:01:06.882583 run create_hlr_db(pid=26559): Terminated: ok {rc=0} 10:01:07.334787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Launched 10:01:07.660377 run osmo-hlr_10.42.42.2(pid=26562): Launched 10:01:07.785211 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:08.350181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Launched 10:01:08.676447 run osmo-stp_10.42.42.5(pid=26565): Launched 10:01:08.800787 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:09.389728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26567): Launched 10:01:09.715612 run osmo-msc_10.42.42.6(pid=26568): Launched 10:01:09.896764 run osmo-stp_10.42.42.5(pid=26565): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] 10:01:10.034278 run osmo-stp_10.42.42.5(pid=26565): stdout: | (launched: 2022-12-10_10:01:08.617774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:10.172734 run osmo-stp_10.42.42.5(pid=26565): stderr: | 20221210100108811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100108811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100108811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100108812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100108812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100108812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100108812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:10.310609 run osmo-stp_10.42.42.5(pid=26565): stdout: | (launched: 2022-12-10_10:01:08.617774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:10.440834 run osmo-stp_10.42.42.5(pid=26565): stderr: | 20221210100108811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100108811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100108811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100108812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100108812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100108812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100108812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:10.596089 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26565): Process ended prematurely: osmo-stp_10.42.42.5(pid=26565) [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:01:10.605575 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:01:10.634000 run osmo-hlr_10.42.42.2(pid=26562): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26562)] 10:01:10.684404 run osmo-hlr_10.42.42.2(pid=26562): stdout: | (launched: 2022-12-10_10:01:07.601919) 10:01:10.736680 run osmo-hlr_10.42.42.2(pid=26562): stderr: | 20221210100107800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100107800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100107800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100107800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100107800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100107800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100107813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100107821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100107821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100107822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:10.809449 run osmo-msc_10.42.42.6(pid=26568): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26568)] 10:01:10.860166 run osmo-msc_10.42.42.6(pid=26568): stdout: | (launched: 2022-12-10_10:01:09.656586) 10:01:10.912286 run osmo-msc_10.42.42.6(pid=26568): stderr: | 20221210100109977 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100109977 DLGLOBAL DEBUG validating counter group 0x7f27d3e89c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100109977 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100109977 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100109977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100109977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100109981 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100109981 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100109981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100109981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:10.964622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Terminating (SIGTERM) 10:01:11.006678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Terminating (SIGTERM) 10:01:11.048671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26567): Terminating (SIGTERM) 10:01:11.091632 --- ParallelTerminationStrategy: PID 26561 died... 10:01:11.111715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Terminated: ok {rc=0} 10:01:11.158487 --- ParallelTerminationStrategy: PID 26564 died... 10:01:11.178080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Terminated: ok {rc=0} 10:01:11.224743 --- ParallelTerminationStrategy: PID 26567 died... 10:01:11.244369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26567): Terminated: ok {rc=0} 10:01:11.333027 bus /sierra_3: Setting Powered False 10:01:12.432162 bus /sierra_3: Setting Powered False 10:01:13.548710 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:01:14.696421 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:14.707895 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:01:14.764927 tst mo_mt_call_osmux.py: using LAC 27616 10:01:14.885687 tst mo_mt_call_osmux.py: using RAC 76 10:01:15.010950 tst mo_mt_call_osmux.py: using CellId 27616 10:01:15.129699 tst mo_mt_call_osmux.py: using BVCI 27617 10:01:15.240623 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:15.251619 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:15.262282 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:15.272854 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:15.283520 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:01:15.294164 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:01:15.408496 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:01:15.526147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:16.090387 run create_hlr_db(pid=26570): Launched 10:01:16.262899 bus /sierra_2: Setting Powered False 10:01:17.326712 run create_hlr_db(pid=26570): Terminated: ok {rc=0} 10:01:17.785140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26572): Launched 10:01:18.090468 run osmo-hlr_10.42.42.2(pid=26573): Launched 10:01:18.205656 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:18.745938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26575): Launched 10:01:19.049704 run osmo-stp_10.42.42.5(pid=26576): Launched 10:01:19.166061 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:19.721700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26578): Launched 10:01:20.028544 run osmo-msc_10.42.42.6(pid=26579): Launched 10:01:20.198571 run osmo-stp_10.42.42.5(pid=26576): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26576)] 10:01:20.326835 run osmo-stp_10.42.42.5(pid=26576): stdout: | (launched: 2022-12-10_10:01:18.994427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:20.455271 run osmo-stp_10.42.42.5(pid=26576): stderr: | 20221210100119164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100119164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100119164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100119165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100119167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100119167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100119167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:20.582273 run osmo-stp_10.42.42.5(pid=26576): stdout: | (launched: 2022-12-10_10:01:18.994427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:20.703499 run osmo-stp_10.42.42.5(pid=26576): stderr: | 20221210100119164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100119164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100119164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100119165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100119167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100119167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100119167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:20.848413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26576): Process ended prematurely: osmo-stp_10.42.42.5(pid=26576) [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26576)] [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:01:20.857280 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:01:20.883883 run osmo-hlr_10.42.42.2(pid=26573): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26573)] 10:01:20.932078 run osmo-hlr_10.42.42.2(pid=26573): stdout: | (launched: 2022-12-10_10:01:18.034990) 10:01:20.982038 run osmo-hlr_10.42.42.2(pid=26573): stderr: | 20221210100118213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100118213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100118213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100118213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100118213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100118213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100118225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100118235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100118235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100118235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:21.051623 run osmo-msc_10.42.42.6(pid=26579): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26579)] 10:01:21.099962 run osmo-msc_10.42.42.6(pid=26579): stdout: | (launched: 2022-12-10_10:01:19.971959) 10:01:21.150230 run osmo-msc_10.42.42.6(pid=26579): stderr: | 20221210100120246 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100120246 DLGLOBAL DEBUG validating counter group 0x7ff20357ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100120246 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100120246 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100120246 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100120247 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100120248 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100120249 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100120249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100120249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:21.200502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26572): Terminating (SIGTERM) 10:01:21.240241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26575): Terminating (SIGTERM) 10:01:21.280073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26578): Terminating (SIGTERM) 10:01:21.320087 --- ParallelTerminationStrategy: PID 26572 died... 10:01:21.339313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26572): Terminated: ok {rc=0} 10:01:21.383314 --- ParallelTerminationStrategy: PID 26575 died... 10:01:21.402019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26575): Terminated: ok {rc=0} 10:01:21.445949 --- ParallelTerminationStrategy: PID 26578 died... 10:01:21.464584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26578): Terminated: ok {rc=0} 10:01:21.548427 bus /sierra_3: Setting Powered False 10:01:22.642963 bus /sierra_3: Setting Powered False 10:01:23.758123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:oc2g --------------------------------------------------------------------- 10:01:24.992411 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:01:24.996441 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 10:01:25.016796 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 10:01:25.043560 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 10:01:25.127612 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 10:01:25.148111 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 10:01:25.175221 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 10:01:25.760748 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 10:01:25.766888 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:25.778577 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:01:25.813448 tst emergency_mo_mt_call.py: using LAC 27617 10:01:25.928931 tst emergency_mo_mt_call.py: using RAC 77 10:01:26.044920 tst emergency_mo_mt_call.py: using CellId 27617 10:01:26.161127 tst emergency_mo_mt_call.py: using BVCI 27618 10:01:26.278533 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:26.289870 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:26.300880 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:26.312189 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:26.323320 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:26.334578 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:01:26.450348 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:01:26.569945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:27.034651 run create_hlr_db(pid=26584): Launched 10:01:27.157441 bus /sierra_2: Setting Powered False 10:01:28.217532 run create_hlr_db(pid=26584): Terminated: ok {rc=0} 10:01:28.635486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26586): Launched 10:01:28.944728 run osmo-hlr_10.42.42.2(pid=26587): Launched 10:01:29.058751 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:29.574446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26589): Launched 10:01:29.873665 run osmo-stp_10.42.42.5(pid=26590): Launched 10:01:29.999264 tst emergency_mo_mt_call.py: using MSISDN 7679 10:01:30.153096 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:30.690216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26592): Launched 10:01:31.032865 run osmo-msc_10.42.42.6(pid=26593): Launched 10:01:31.345212 run osmo-stp_10.42.42.5(pid=26590): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26590)] 10:01:31.613579 run osmo-stp_10.42.42.5(pid=26590): stdout: | (launched: 2022-12-10_10:01:29.819322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:31.854679 run osmo-stp_10.42.42.5(pid=26590): stderr: | 20221210100129991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100129992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100129992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100129992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100129993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100129993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100129993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:32.025049 run osmo-stp_10.42.42.5(pid=26590): stdout: | (launched: 2022-12-10_10:01:29.819322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:32.157459 run osmo-stp_10.42.42.5(pid=26590): stderr: | 20221210100129991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100129992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100129992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100129992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100129993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100129993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100129993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:32.318060 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26590): Process ended prematurely: osmo-stp_10.42.42.5(pid=26590) [trial-2373↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26590)] [trial-2373↪emergency:oc2g↪emergency_mo_mt_call.py:19] 10:01:32.327892 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 10:01:32.359319 run osmo-hlr_10.42.42.2(pid=26587): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26587)] 10:01:32.412020 run osmo-hlr_10.42.42.2(pid=26587): stdout: | (launched: 2022-12-10_10:01:28.879294) 10:01:32.465876 run osmo-hlr_10.42.42.2(pid=26587): stderr: | 20221210100129067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100129067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100129067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100129067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100129067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100129068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100129079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100129088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100129088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100129089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:32.539691 run osmo-msc_10.42.42.6(pid=26593): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26593)] 10:01:32.591446 run osmo-msc_10.42.42.6(pid=26593): stdout: | (launched: 2022-12-10_10:01:30.960191) 10:01:32.645193 run osmo-msc_10.42.42.6(pid=26593): stderr: | 20221210100131500 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100131500 DLGLOBAL DEBUG validating counter group 0x7f552c17ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100131500 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100131501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100131501 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100131501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100131503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100131503 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100131503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100131503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:32.698874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26586): Terminating (SIGTERM) 10:01:32.741479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26589): Terminating (SIGTERM) 10:01:32.784240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26592): Terminating (SIGTERM) 10:01:32.827879 --- ParallelTerminationStrategy: PID 26586 died... 10:01:32.847897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26586): Terminated: ok {rc=0} 10:01:32.895152 --- ParallelTerminationStrategy: PID 26589 died... 10:01:32.915122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26589): Terminated: ok {rc=0} 10:01:32.962484 --- ParallelTerminationStrategy: PID 26592 died... 10:01:32.982425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26592): Terminated: ok {rc=0} 10:01:33.071583 bus /sierra_3: Setting Powered False 10:01:34.171441 bus /sierra_3: Setting Powered False 10:01:35.289340 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 10:01:36.375787 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:36.387744 tst emergency:oc2g: Using 1 x bts (candidates: 1) 10:01:36.426377 tst emergency_preemptive_call.py: using LAC 27618 10:01:36.545469 tst emergency_preemptive_call.py: using RAC 78 10:01:36.662362 tst emergency_preemptive_call.py: using CellId 27618 10:01:36.783444 tst emergency_preemptive_call.py: using BVCI 27619 10:01:36.892599 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:36.903274 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:36.913831 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:36.924271 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:36.934724 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 10:01:36.945164 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:01:37.062577 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:01:37.182679 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:01:37.298653 tst emergency:oc2g: Using 1 x modem (candidates: 4) 10:01:37.415758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:37.915628 run create_hlr_db(pid=26595): Launched 10:01:38.038864 bus /sierra_2: Setting Powered False 10:01:39.102679 run create_hlr_db(pid=26595): Terminated: ok {rc=0} 10:01:39.534009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26597): Launched 10:01:39.832728 run osmo-hlr_10.42.42.2(pid=26598): Launched 10:01:39.945686 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:40.459165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26600): Launched 10:01:40.756234 run osmo-stp_10.42.42.5(pid=26601): Launched 10:01:40.877112 tst emergency_preemptive_call.py: using MSISDN 7680 10:01:41.028769 run osmo-msc_10.42.42.6: Starting osmo-msc 10:01:41.565889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26603): Launched 10:01:41.863779 run osmo-msc_10.42.42.6(pid=26604): Launched 10:01:42.030828 run osmo-stp_10.42.42.5(pid=26601): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26601)] 10:01:42.157495 run osmo-stp_10.42.42.5(pid=26601): stdout: | (launched: 2022-12-10_10:01:40.702071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:42.283911 run osmo-stp_10.42.42.5(pid=26601): stderr: | 20221210100140873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100140873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100140873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100140874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100140874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100140874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100140875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:42.407859 run osmo-stp_10.42.42.5(pid=26601): stdout: | (launched: 2022-12-10_10:01:40.702071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:42.526540 run osmo-stp_10.42.42.5(pid=26601): stderr: | 20221210100140873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100140873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100140873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100140874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100140874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100140874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100140875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:01:42.668590 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26601): Process ended prematurely: osmo-stp_10.42.42.5(pid=26601) [trial-2373↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26601)] [trial-2373↪emergency:oc2g↪emergency_preemptive_call.py:32] 10:01:42.676631 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 10:01:42.702802 run osmo-hlr_10.42.42.2(pid=26598): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26598)] 10:01:42.750984 run osmo-hlr_10.42.42.2(pid=26598): stdout: | (launched: 2022-12-10_10:01:39.778295) 10:01:42.800479 run osmo-hlr_10.42.42.2(pid=26598): stderr: | 20221210100139953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100139953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100139953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100139953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100139953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100139953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100139965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100139974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100139974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100139974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:01:42.869912 run osmo-msc_10.42.42.6(pid=26604): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26604)] 10:01:42.917782 run osmo-msc_10.42.42.6(pid=26604): stdout: | (launched: 2022-12-10_10:01:41.809109) 10:01:42.967141 run osmo-msc_10.42.42.6(pid=26604): stderr: | 20221210100142078 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100142078 DLGLOBAL DEBUG validating counter group 0x7f6d0e725c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100142078 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100142079 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100142079 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100142079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100142081 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100142081 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100142081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100142081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:01:43.016868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26597): Terminating (SIGTERM) 10:01:43.056649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26600): Terminating (SIGTERM) 10:01:43.096426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26603): Terminating (SIGTERM) 10:01:43.136608 --- ParallelTerminationStrategy: PID 26597 died... 10:01:43.155660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26597): Terminated: ok {rc=0} 10:01:43.199988 --- ParallelTerminationStrategy: PID 26600 died... 10:01:43.218712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26600): Terminated: ok {rc=0} 10:01:43.262650 --- ParallelTerminationStrategy: PID 26603 died... 10:01:43.281469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26603): Terminated: ok {rc=0} 10:01:43.367942 bus /sierra_9: Setting Powered False 10:01:44.467936 bus /sierra_9: Setting Powered False 10:01:45.584380 bus /sierra_8: Setting Powered False 10:01:46.686303 bus /sierra_8: Setting Powered False 10:01:47.805676 bus /sierra_3: Setting Powered False 10:01:48.904817 bus /sierra_3: Setting Powered False 10:01:50.021119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:oc2g --------------------------------------------------------------------- 10:01:51.283837 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:01:51.288641 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 10:01:51.309649 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 10:01:51.348210 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 10:01:51.433579 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 10:01:51.453997 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 10:01:51.492074 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 10:01:52.081957 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 10:01:52.136908 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.148062 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:01:52.182605 tst cs_paging_gprs_active.py: using LAC 27619 10:01:52.309280 tst cs_paging_gprs_active.py: using RAC 79 10:01:52.427760 tst cs_paging_gprs_active.py: using CellId 27619 10:01:52.545487 tst cs_paging_gprs_active.py: using BVCI 27620 10:01:52.656728 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.667297 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.677680 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.687861 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.698070 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.708142 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.718417 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.728506 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:01:52.738836 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:01:52.854610 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:01:52.969064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:01:53.173287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:53.479165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26609): Launched 10:01:53.744374 run iperf3-srv_10.42.42.10(pid=26610): Launched 10:01:53.858742 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:01:54.063168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:01:54.368872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26611): Launched 10:01:54.634653 run iperf3-srv_10.42.42.10(pid=26612): Launched 10:01:54.749403 tst cs_paging_gprs_active.py:38: start network... 10:01:54.953947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:01:55.425129 run create_hlr_db(pid=26613): Launched 10:01:55.549932 bus /sierra_2: Setting Powered False 10:01:56.610703 run create_hlr_db(pid=26613): Terminated: ok {rc=0} 10:01:57.056578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26615): Launched 10:01:57.381668 run osmo-hlr_10.42.42.2(pid=26616): Launched 10:01:57.506549 run osmo-stp_10.42.42.5: Starting osmo-stp 10:01:58.065151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26618): Launched 10:01:58.389447 run osmo-stp_10.42.42.5(pid=26619): Launched 10:01:58.514136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:01:59.076849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26621): Launched 10:01:59.201622 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:01:59.477418 run patchelf(pid=26622): Launched 10:01:59.660371 run osmo-stp_10.42.42.5(pid=26619): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26619)] 10:01:59.799027 run osmo-stp_10.42.42.5(pid=26619): stdout: | (launched: 2022-12-10_10:01:58.330883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:01:59.939551 run osmo-stp_10.42.42.5(pid=26619): stderr: | 20221210100158525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100158525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100158525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100158526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100158526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100158526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100158526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:00.079964 run osmo-stp_10.42.42.5(pid=26619): stdout: | (launched: 2022-12-10_10:01:58.330883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:00.214192 run osmo-stp_10.42.42.5(pid=26619): stderr: | 20221210100158525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100158525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100158525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100158526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100158526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100158526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100158526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:00.373377 run patchelf(pid=26622): Terminating (SIGINT) 10:02:00.558686 run patchelf(pid=26622): Terminated: ok {rc=0} 10:02:00.691817 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26619): Process ended prematurely: osmo-stp_10.42.42.5(pid=26619) [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26619)] [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py:38] 10:02:00.701773 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:02:00.731048 run osmo-hlr_10.42.42.2(pid=26616): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26616)] 10:02:00.781373 run osmo-hlr_10.42.42.2(pid=26616): stdout: | (launched: 2022-12-10_10:01:57.323196) 10:02:00.833502 run osmo-hlr_10.42.42.2(pid=26616): stderr: | 20221210100157523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100157523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100157523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100157523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100157523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100157523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100157535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100157545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100157546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100157546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:00.896066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26609): Terminating (SIGTERM) 10:02:00.954576 run iperf3-srv_10.42.42.10(pid=26610): Terminating (SIGTERM) 10:02:00.999930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26611): Terminating (SIGTERM) 10:02:01.043240 run iperf3-srv_10.42.42.10(pid=26612): Terminating (SIGTERM) 10:02:01.086987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26615): Terminating (SIGTERM) 10:02:01.130311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26618): Terminating (SIGTERM) 10:02:01.174607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26621): Terminating (SIGTERM) 10:02:01.219940 --- ParallelTerminationStrategy: PID 26609 died... 10:02:01.241004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26609): Terminated: ok {rc=0} 10:02:01.290601 --- ParallelTerminationStrategy: PID 26610 died... 10:02:01.310406 run iperf3-srv_10.42.42.10(pid=26610): Terminated {rc=256} 10:02:01.358021 --- ParallelTerminationStrategy: PID 26611 died... 10:02:01.377936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26611): Terminated: ok {rc=0} 10:02:01.426618 --- ParallelTerminationStrategy: PID 26612 died... 10:02:01.446440 run iperf3-srv_10.42.42.10(pid=26612): Terminated {rc=256} 10:02:01.494249 --- ParallelTerminationStrategy: PID 26615 died... 10:02:01.513801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26615): Terminated: ok {rc=0} 10:02:01.561379 --- ParallelTerminationStrategy: PID 26618 died... 10:02:01.580910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26618): Terminated: ok {rc=0} 10:02:01.629314 --- ParallelTerminationStrategy: PID 26621 died... 10:02:01.648630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26621): Terminated: ok {rc=0} 10:02:01.735867 bus /gobi_0: Setting Powered False 10:02:02.834923 bus /gobi_0: Setting Powered False 10:02:03.950169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g iperf3.py ---------------------------------------------- 10:02:05.095784 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.106840 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:02:05.142482 tst iperf3.py: using LAC 27620 10:02:05.264523 tst iperf3.py: using RAC 80 10:02:05.392667 tst iperf3.py: using CellId 27620 10:02:05.522761 tst iperf3.py: using BVCI 27621 10:02:05.643159 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.654323 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.665509 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.676702 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.687652 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.698737 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.709931 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.720829 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:05.732058 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:02:05.853950 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:02:06.074323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:02:06.400294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623): Launched 10:02:06.684381 run iperf3-srv_10.42.42.10(pid=26624): Launched 10:02:06.806724 tst iperf3.py:8: start network... 10:02:07.026985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:07.533363 run create_hlr_db(pid=26625): Launched 10:02:07.657659 bus /gobi_6: Setting Powered False 10:02:08.722199 run create_hlr_db(pid=26625): Terminated: ok {rc=0} 10:02:09.157364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Launched 10:02:09.461929 run osmo-hlr_10.42.42.2(pid=26628): Launched 10:02:09.578918 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:10.106159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Launched 10:02:10.409326 run osmo-stp_10.42.42.5(pid=26631): Launched 10:02:10.525324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:11.053153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26633): Launched 10:02:11.170333 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:11.427276 run patchelf(pid=26634): Launched 10:02:11.597185 run osmo-stp_10.42.42.5(pid=26631): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)] 10:02:11.725889 run osmo-stp_10.42.42.5(pid=26631): stdout: | (launched: 2022-12-10_10:02:10.354243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:11.856074 run osmo-stp_10.42.42.5(pid=26631): stderr: | 20221210100210526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100210526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100210526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100210527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100210527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100210527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100210527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:11.987062 run osmo-stp_10.42.42.5(pid=26631): stdout: | (launched: 2022-12-10_10:02:10.354243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:12.111378 run osmo-stp_10.42.42.5(pid=26631): stderr: | 20221210100210526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100210526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100210526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100210527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100210527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100210527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100210527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:12.259028 run patchelf(pid=26634): Terminating (SIGINT) 10:02:12.429963 run patchelf(pid=26634): Terminated: ok {rc=0} 10:02:12.553635 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26631): Process ended prematurely: osmo-stp_10.42.42.5(pid=26631) [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)] [trial-2373↪gprs:oc2g↪iperf3.py:8] 10:02:12.562868 tst iperf3.py:8: Test FAILED (7.5 sec) 10:02:12.589961 run osmo-hlr_10.42.42.2(pid=26628): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26628)] 10:02:12.637427 run osmo-hlr_10.42.42.2(pid=26628): stdout: | (launched: 2022-12-10_10:02:09.406549) 10:02:12.686773 run osmo-hlr_10.42.42.2(pid=26628): stderr: | 20221210100209583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100209583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100209583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100209583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100209583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100209583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100209595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100209604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100209604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100209604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:12.736448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623): Terminating (SIGTERM) 10:02:12.776091 run iperf3-srv_10.42.42.10(pid=26624): Terminating (SIGTERM) 10:02:12.815740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Terminating (SIGTERM) 10:02:12.855324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Terminating (SIGTERM) 10:02:12.894735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26633): Terminating (SIGTERM) 10:02:12.934561 --- ParallelTerminationStrategy: PID 26623 died... 10:02:12.953672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623): Terminated: ok {rc=0} 10:02:12.997803 --- ParallelTerminationStrategy: PID 26624 died... 10:02:13.016206 run iperf3-srv_10.42.42.10(pid=26624): Terminated {rc=256} 10:02:13.060253 --- ParallelTerminationStrategy: PID 26627 died... 10:02:13.079027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Terminated: ok {rc=0} 10:02:13.122969 --- ParallelTerminationStrategy: PID 26630 died... 10:02:13.141592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Terminated: ok {rc=0} 10:02:13.185658 --- ParallelTerminationStrategy: PID 26633 died... 10:02:13.204353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26633): Terminated: ok {rc=0} 10:02:13.287546 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g iperf3m4.py ---------------------------------------------- 10:02:14.437449 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:14.449590 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:02:14.487267 tst iperf3m4.py: using LAC 27621 10:02:14.616900 tst iperf3m4.py: using RAC 81 10:02:14.744866 tst iperf3m4.py: using CellId 27621 10:02:14.872059 tst iperf3m4.py: using BVCI 27622 10:02:14.991255 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.002254 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.013067 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.024109 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.035149 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.046353 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.057427 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.068376 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:15.079614 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:02:15.199831 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:02:15.321234 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:02:15.438041 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:02:15.551758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:02:15.757341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:02:16.130895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26635): Launched 10:02:16.443579 run iperf3-srv_10.42.42.10(pid=26636): Launched 10:02:16.582978 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:02:16.811229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:02:17.151121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26637): Launched 10:02:17.447785 run iperf3-srv_10.42.42.10(pid=26638): Launched 10:02:17.571100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:02:17.791821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:02:18.119795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26639): Launched 10:02:18.404504 run iperf3-srv_10.42.42.10(pid=26640): Launched 10:02:18.527401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:02:18.746972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:02:19.073574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26641): Launched 10:02:19.358565 run iperf3-srv_10.42.42.10(pid=26642): Launched 10:02:19.481604 tst iperf3m4.py:8: start network... 10:02:19.702485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:20.209278 run create_hlr_db(pid=26643): Launched 10:02:20.334073 bus /gobi_6: Setting Powered False 10:02:21.398805 run create_hlr_db(pid=26643): Terminated: ok {rc=0} 10:02:21.835567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26645): Launched 10:02:22.141373 run osmo-hlr_10.42.42.2(pid=26646): Launched 10:02:22.257989 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:22.801308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26648): Launched 10:02:23.105241 run osmo-stp_10.42.42.5(pid=26649): Launched 10:02:23.221243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:23.747715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26651): Launched 10:02:23.865117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:24.121926 run patchelf(pid=26652): Launched 10:02:24.291673 run osmo-stp_10.42.42.5(pid=26649): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26649)] 10:02:24.420586 run osmo-stp_10.42.42.5(pid=26649): stdout: | (launched: 2022-12-10_10:02:23.049598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:24.551515 run osmo-stp_10.42.42.5(pid=26649): stderr: | 20221210100223222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100223222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100223223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100223223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100223223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100223224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100223224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:24.682397 run osmo-stp_10.42.42.5(pid=26649): stdout: | (launched: 2022-12-10_10:02:23.049598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:24.807307 run osmo-stp_10.42.42.5(pid=26649): stderr: | 20221210100223222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100223222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100223223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100223223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100223223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100223224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100223224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:24.955233 run patchelf(pid=26652): Terminating (SIGINT) 10:02:25.125844 run patchelf(pid=26652): Terminated: ok {rc=0} 10:02:25.249111 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26649): Process ended prematurely: osmo-stp_10.42.42.5(pid=26649) [trial-2373↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26649)] [trial-2373↪gprs:oc2g↪iperf3m4.py:8] 10:02:25.258739 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:02:25.285989 run osmo-hlr_10.42.42.2(pid=26646): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26646)] 10:02:25.333523 run osmo-hlr_10.42.42.2(pid=26646): stdout: | (launched: 2022-12-10_10:02:22.085556) 10:02:25.382864 run osmo-hlr_10.42.42.2(pid=26646): stderr: | 20221210100222265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100222265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100222265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100222265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100222265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100222265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100222278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100222286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100222287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100222287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:25.432498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26635): Terminating (SIGTERM) 10:02:25.472392 run iperf3-srv_10.42.42.10(pid=26636): Terminating (SIGTERM) 10:02:25.512051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26637): Terminating (SIGTERM) 10:02:25.551831 run iperf3-srv_10.42.42.10(pid=26638): Terminating (SIGTERM) 10:02:25.591432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26639): Terminating (SIGTERM) 10:02:25.631194 run iperf3-srv_10.42.42.10(pid=26640): Terminating (SIGTERM) 10:02:25.671327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26641): Terminating (SIGTERM) 10:02:25.710948 run iperf3-srv_10.42.42.10(pid=26642): Terminating (SIGTERM) 10:02:25.750380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26645): Terminating (SIGTERM) 10:02:25.789990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26648): Terminating (SIGTERM) 10:02:25.829598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26651): Terminating (SIGTERM) 10:02:25.869551 --- ParallelTerminationStrategy: PID 26635 died... 10:02:25.888268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26635): Terminated: ok {rc=0} 10:02:25.932428 --- ParallelTerminationStrategy: PID 26636 died... 10:02:25.951146 run iperf3-srv_10.42.42.10(pid=26636): Terminated {rc=256} 10:02:25.994955 --- ParallelTerminationStrategy: PID 26637 died... 10:02:26.013640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26637): Terminated: ok {rc=0} 10:02:26.057843 --- ParallelTerminationStrategy: PID 26638 died... 10:02:26.076313 run iperf3-srv_10.42.42.10(pid=26638): Terminated {rc=256} 10:02:26.119873 --- ParallelTerminationStrategy: PID 26639 died... 10:02:26.138421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26639): Terminated: ok {rc=0} 10:02:26.182253 --- ParallelTerminationStrategy: PID 26640 died... 10:02:26.200850 run iperf3-srv_10.42.42.10(pid=26640): Terminated {rc=256} 10:02:26.245209 --- ParallelTerminationStrategy: PID 26641 died... 10:02:26.263705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26641): Terminated: ok {rc=0} 10:02:26.307640 --- ParallelTerminationStrategy: PID 26642 died... 10:02:26.326417 run iperf3-srv_10.42.42.10(pid=26642): Terminated {rc=256} 10:02:26.370280 --- ParallelTerminationStrategy: PID 26645 died... 10:02:26.389079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26645): Terminated: ok {rc=0} 10:02:26.433471 --- ParallelTerminationStrategy: PID 26648 died... 10:02:26.452158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26648): Terminated: ok {rc=0} 10:02:26.495997 --- ParallelTerminationStrategy: PID 26651 died... 10:02:26.514702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26651): Terminated: ok {rc=0} 10:02:26.600047 bus /gobi_4: Setting Powered False 10:02:27.701239 bus /gobi_4: Setting Powered False 10:02:28.816320 bus /gobi_1: Setting Powered False 10:02:29.915691 bus /gobi_1: Setting Powered False 10:02:31.029739 bus /gobi_0: Setting Powered False 10:02:32.139778 bus /gobi_0: Setting Powered False 10:02:33.259761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g ping.py ---------------------------------------------- 10:02:34.362675 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.373658 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:02:34.409554 tst ping.py: using LAC 27622 10:02:34.532203 tst ping.py: using RAC 82 10:02:34.658268 tst ping.py: using CellId 27622 10:02:34.775886 tst ping.py: using BVCI 27623 10:02:34.883970 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.894571 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.905068 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.915414 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.925722 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.936033 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.946437 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:34.956603 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:02:35.068440 tst ping.py:19: start network... 10:02:35.270448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:35.734800 run create_hlr_db(pid=26653): Launched 10:02:35.857080 bus /gobi_6: Setting Powered False 10:02:36.920867 run create_hlr_db(pid=26653): Terminated: ok {rc=0} 10:02:37.368239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26656): Launched 10:02:37.689391 run osmo-hlr_10.42.42.2(pid=26657): Launched 10:02:37.812216 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:38.368498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26659): Launched 10:02:38.689370 run osmo-stp_10.42.42.5(pid=26660): Launched 10:02:38.812274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:39.368642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26662): Launched 10:02:39.492499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:39.763165 run patchelf(pid=26663): Launched 10:02:39.941681 run osmo-stp_10.42.42.5(pid=26660): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26660)] 10:02:40.077384 run osmo-stp_10.42.42.5(pid=26660): stdout: | (launched: 2022-12-10_10:02:38.631336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:40.214729 run osmo-stp_10.42.42.5(pid=26660): stderr: | 20221210100238822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100238822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100238823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100238823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100238824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100238824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100238824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:40.352304 run osmo-stp_10.42.42.5(pid=26660): stdout: | (launched: 2022-12-10_10:02:38.631336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:40.484000 run osmo-stp_10.42.42.5(pid=26660): stderr: | 20221210100238822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100238822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100238823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100238823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100238824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100238824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100238824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:40.640061 run patchelf(pid=26663): Terminating (SIGINT) 10:02:40.820281 run patchelf(pid=26663): Terminated: ok {rc=0} 10:02:40.949798 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26660): Process ended prematurely: osmo-stp_10.42.42.5(pid=26660) [trial-2373↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26660)] [trial-2373↪gprs:oc2g↪ping.py:22] 10:02:40.959183 tst ping.py:22: Test FAILED (6.6 sec) 10:02:40.988182 run osmo-hlr_10.42.42.2(pid=26657): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26657)] 10:02:41.038546 run osmo-hlr_10.42.42.2(pid=26657): stdout: | (launched: 2022-12-10_10:02:37.631401) 10:02:41.090759 run osmo-hlr_10.42.42.2(pid=26657): stderr: | 20221210100237830 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100237830 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100237830 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100237830 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100237830 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100237830 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100237842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100237851 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100237851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100237851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:41.143582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26656): Terminating (SIGTERM) 10:02:41.185910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26659): Terminating (SIGTERM) 10:02:41.228189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26662): Terminating (SIGTERM) 10:02:41.270757 --- ParallelTerminationStrategy: PID 26656 died... 10:02:41.290840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26656): Terminated: ok {rc=0} 10:02:41.337938 --- ParallelTerminationStrategy: PID 26659 died... 10:02:41.357681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26659): Terminated: ok {rc=0} 10:02:41.404461 --- ParallelTerminationStrategy: PID 26662 died... 10:02:41.424227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26662): Terminated: ok {rc=0} 10:02:41.512380 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 10:02:42.600705 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:42.612563 tst gprs:oc2g: Using 1 x bts (candidates: 1) 10:02:42.650286 tst ping_idle_ping.py: using LAC 27623 10:02:42.769352 tst ping_idle_ping.py: using RAC 83 10:02:42.888096 tst ping_idle_ping.py: using CellId 27623 10:02:43.007432 tst ping_idle_ping.py: using BVCI 27624 10:02:43.117550 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:43.128002 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:43.138418 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:43.148757 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:43.159061 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:43.169386 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:43.179820 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 10:02:43.190329 tst gprs:oc2g: Using 1 x modem (candidates: 4) 10:02:43.303381 tst ping_idle_ping.py:24: start network... 10:02:43.504083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:43.970785 run create_hlr_db(pid=26664): Launched 10:02:44.092636 bus /gobi_6: Setting Powered False 10:02:45.153424 run create_hlr_db(pid=26664): Terminated: ok {rc=0} 10:02:45.593896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Launched 10:02:45.941658 run osmo-hlr_10.42.42.2(pid=26667): Launched 10:02:46.175866 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:46.884193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Launched 10:02:47.219100 run osmo-stp_10.42.42.5(pid=26670): Launched 10:02:47.422680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:48.006824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26672): Launched 10:02:48.130802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:48.402301 run patchelf(pid=26673): Launched 10:02:48.580599 run osmo-stp_10.42.42.5(pid=26670): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] 10:02:48.715914 run osmo-stp_10.42.42.5(pid=26670): stdout: | (launched: 2022-12-10_10:02:47.153506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:48.853713 run osmo-stp_10.42.42.5(pid=26670): stderr: | 20221210100247424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100247424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100247425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100247425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100247425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100247425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100247426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:48.991081 run osmo-stp_10.42.42.5(pid=26670): stdout: | (launched: 2022-12-10_10:02:47.153506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:02:49.122496 run osmo-stp_10.42.42.5(pid=26670): stderr: | 20221210100247424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100247424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100247425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100247425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100247425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100247425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100247426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:02:49.278233 run patchelf(pid=26673): Terminating (SIGINT) 10:02:49.458424 run patchelf(pid=26673): Terminated: ok {rc=0} 10:02:49.588622 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26670): Process ended prematurely: osmo-stp_10.42.42.5(pid=26670) [trial-2373↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] [trial-2373↪gprs:oc2g↪ping_idle_ping.py:27] 10:02:49.598271 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 10:02:49.626956 run osmo-hlr_10.42.42.2(pid=26667): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26667)] 10:02:49.676511 run osmo-hlr_10.42.42.2(pid=26667): stdout: | (launched: 2022-12-10_10:02:45.868301) 10:02:49.727856 run osmo-hlr_10.42.42.2(pid=26667): stderr: | 20221210100246136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100246136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100246136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100246136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100246136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100246136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100246158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100246178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100246178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100246178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:02:49.779989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Terminating (SIGTERM) 10:02:49.821459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Terminating (SIGTERM) 10:02:49.863305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26672): Terminating (SIGTERM) 10:02:49.905735 --- ParallelTerminationStrategy: PID 26666 died... 10:02:49.925710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26666): Terminated: ok {rc=0} 10:02:49.972433 --- ParallelTerminationStrategy: PID 26669 died... 10:02:49.992037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26669): Terminated: ok {rc=0} 10:02:50.038843 --- ParallelTerminationStrategy: PID 26672 died... 10:02:50.058405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26672): Terminated: ok {rc=0} 10:02:50.147008 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 10:02:51.438901 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:02:51.444857 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:02:51.467160 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:02:51.506596 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:02:51.595494 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:02:51.616416 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:02:51.655730 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:02:52.251256 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:02:52.302774 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.313874 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:02:52.351468 tst cs_paging_gprs_active.py: using LAC 27624 10:02:52.477808 tst cs_paging_gprs_active.py: using RAC 84 10:02:52.605723 tst cs_paging_gprs_active.py: using CellId 27624 10:02:52.730769 tst cs_paging_gprs_active.py: using BVCI 27625 10:02:52.847033 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.858207 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.869236 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.880280 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.891306 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.902393 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.913715 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.924723 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:02:52.935998 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:02:53.053425 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:02:53.172272 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:02:53.389802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:02:53.711961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26678): Launched 10:02:53.989553 run iperf3-srv_10.42.42.10(pid=26679): Launched 10:02:54.110247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:02:54.326891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:02:54.649689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26680): Launched 10:02:54.927916 run iperf3-srv_10.42.42.10(pid=26681): Launched 10:02:55.047742 tst cs_paging_gprs_active.py:38: start network... 10:02:55.264221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:02:55.761577 run create_hlr_db(pid=26682): Launched 10:02:55.883815 bus /gobi_6: Setting Powered False 10:02:56.946994 run create_hlr_db(pid=26682): Terminated: ok {rc=0} 10:02:57.376921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26684): Launched 10:02:57.678254 run osmo-hlr_10.42.42.2(pid=26685): Launched 10:02:57.792086 run osmo-stp_10.42.42.5: Starting osmo-stp 10:02:58.309697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26687): Launched 10:02:58.609827 run osmo-stp_10.42.42.5(pid=26688): Launched 10:02:58.724659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:02:59.245809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26690): Launched 10:02:59.361167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:02:59.614676 run patchelf(pid=26691): Launched 10:02:59.781494 run osmo-stp_10.42.42.5(pid=26688): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26688)] 10:02:59.909318 run osmo-stp_10.42.42.5(pid=26688): stdout: | (launched: 2022-12-10_10:02:58.555325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:00.038827 run osmo-stp_10.42.42.5(pid=26688): stderr: | 20221210100258725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100258725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100258725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100258725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100258728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100258728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100258728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:00.168058 run osmo-stp_10.42.42.5(pid=26688): stdout: | (launched: 2022-12-10_10:02:58.555325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:00.291467 run osmo-stp_10.42.42.5(pid=26688): stderr: | 20221210100258725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100258725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100258725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100258725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100258728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100258728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100258728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:00.437926 run patchelf(pid=26691): Terminating (SIGINT) 10:03:00.607262 run patchelf(pid=26691): Terminated: ok {rc=0} 10:03:00.729212 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26688): Process ended prematurely: osmo-stp_10.42.42.5(pid=26688) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26688)] [trial-2373↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:03:00.738565 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:03:00.765447 run osmo-hlr_10.42.42.2(pid=26685): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26685)] 10:03:00.813296 run osmo-hlr_10.42.42.2(pid=26685): stdout: | (launched: 2022-12-10_10:02:57.623629) 10:03:00.883242 run osmo-hlr_10.42.42.2(pid=26685): stderr: | 20221210100257800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100257800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100257800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100257800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100257800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100257800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100257811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100257820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100257820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100257820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:00.940676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26678): Terminating (SIGTERM) 10:03:00.991049 run iperf3-srv_10.42.42.10(pid=26679): Terminating (SIGTERM) 10:03:01.038403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26680): Terminating (SIGTERM) 10:03:01.083762 run iperf3-srv_10.42.42.10(pid=26681): Terminating (SIGTERM) 10:03:01.129983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26684): Terminating (SIGTERM) 10:03:01.177431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26687): Terminating (SIGTERM) 10:03:01.224639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26690): Terminating (SIGTERM) 10:03:01.273587 --- ParallelTerminationStrategy: PID 26678 died... 10:03:01.294462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26678): Terminated: ok {rc=0} 10:03:01.346235 --- ParallelTerminationStrategy: PID 26679 died... 10:03:01.366978 run iperf3-srv_10.42.42.10(pid=26679): Terminated {rc=256} 10:03:01.416739 --- ParallelTerminationStrategy: PID 26680 died... 10:03:01.438428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26680): Terminated: ok {rc=0} 10:03:01.489547 --- ParallelTerminationStrategy: PID 26681 died... 10:03:01.510046 run iperf3-srv_10.42.42.10(pid=26681): Terminated {rc=256} 10:03:01.560497 --- ParallelTerminationStrategy: PID 26684 died... 10:03:01.581544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26684): Terminated: ok {rc=0} 10:03:01.631271 --- ParallelTerminationStrategy: PID 26687 died... 10:03:01.652747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26687): Terminated: ok {rc=0} 10:03:01.703536 --- ParallelTerminationStrategy: PID 26690 died... 10:03:01.724434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26690): Terminated: ok {rc=0} 10:03:01.822863 bus /gobi_0: Setting Powered False 10:03:02.935879 bus /gobi_0: Setting Powered False 10:03:04.053872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:03:05.199625 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.211240 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:03:05.249047 tst iperf3.py: using LAC 27625 10:03:05.366807 tst iperf3.py: using RAC 85 10:03:05.486175 tst iperf3.py: using CellId 27625 10:03:05.604642 tst iperf3.py: using BVCI 27626 10:03:05.713695 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.724208 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.734783 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.745352 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.755783 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.766219 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.776682 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.787129 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:05.797769 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:03:05.912940 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:03:06.115251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:03:06.417325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26693): Launched 10:03:06.678372 run iperf3-srv_10.42.42.10(pid=26694): Launched 10:03:06.790180 tst iperf3.py:8: start network... 10:03:06.990185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:07.454191 run create_hlr_db(pid=26695): Launched 10:03:07.575504 bus /gobi_6: Setting Powered False 10:03:08.634802 run create_hlr_db(pid=26695): Terminated: ok {rc=0} 10:03:09.071661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26697): Launched 10:03:09.390595 run osmo-hlr_10.42.42.2(pid=26698): Launched 10:03:09.512524 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:10.065704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26700): Launched 10:03:10.386766 run osmo-stp_10.42.42.5(pid=26701): Launched 10:03:10.509054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:03:11.059341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26703): Launched 10:03:11.182844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:03:11.451996 run patchelf(pid=26704): Launched 10:03:11.630707 run osmo-stp_10.42.42.5(pid=26701): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26701)] 10:03:11.766824 run osmo-stp_10.42.42.5(pid=26701): stdout: | (launched: 2022-12-10_10:03:10.329054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:11.904425 run osmo-stp_10.42.42.5(pid=26701): stderr: | 20221210100310521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100310522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100310522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100310522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100310523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100310523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100310523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:12.042478 run osmo-stp_10.42.42.5(pid=26701): stdout: | (launched: 2022-12-10_10:03:10.329054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:12.174018 run osmo-stp_10.42.42.5(pid=26701): stderr: | 20221210100310521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100310522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100310522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100310522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100310523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100310523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100310523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:12.329952 run patchelf(pid=26704): Terminating (SIGINT) 10:03:12.510262 run patchelf(pid=26704): Terminated: ok {rc=0} 10:03:12.640385 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26701): Process ended prematurely: osmo-stp_10.42.42.5(pid=26701) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26701)] [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 10:03:12.650557 tst iperf3.py:8: Test FAILED (7.5 sec) 10:03:12.679585 run osmo-hlr_10.42.42.2(pid=26698): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26698)] 10:03:12.730221 run osmo-hlr_10.42.42.2(pid=26698): stdout: | (launched: 2022-12-10_10:03:09.333099) 10:03:12.782401 run osmo-hlr_10.42.42.2(pid=26698): stderr: | 20221210100309529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100309529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100309529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100309529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100309529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100309529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100309541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100309550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100309550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100309550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:12.835056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26693): Terminating (SIGTERM) 10:03:12.877378 run iperf3-srv_10.42.42.10(pid=26694): Terminating (SIGTERM) 10:03:12.919712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26697): Terminating (SIGTERM) 10:03:12.962147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26700): Terminating (SIGTERM) 10:03:13.004358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26703): Terminating (SIGTERM) 10:03:13.046890 --- ParallelTerminationStrategy: PID 26693 died... 10:03:13.066948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26693): Terminated: ok {rc=0} 10:03:13.113839 --- ParallelTerminationStrategy: PID 26694 died... 10:03:13.133319 run iperf3-srv_10.42.42.10(pid=26694): Terminated {rc=256} 10:03:13.179976 --- ParallelTerminationStrategy: PID 26697 died... 10:03:13.199577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26697): Terminated: ok {rc=0} 10:03:13.246232 --- ParallelTerminationStrategy: PID 26700 died... 10:03:13.265746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26700): Terminated: ok {rc=0} 10:03:13.312430 --- ParallelTerminationStrategy: PID 26703 died... 10:03:13.332009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26703): Terminated: ok {rc=0} 10:03:13.420496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:03:14.571501 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:14.583380 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:03:14.619669 tst iperf3m4.py: using LAC 27626 10:03:14.740542 tst iperf3m4.py: using RAC 86 10:03:14.867489 tst iperf3m4.py: using CellId 27626 10:03:14.994077 tst iperf3m4.py: using BVCI 27627 10:03:15.112399 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.123983 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.135083 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.146489 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.158175 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.169364 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.180763 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.191939 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:15.203255 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:03:15.322878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:03:15.442543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:03:15.558820 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:03:15.677348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:03:15.901126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:03:16.234926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26710): Launched 10:03:16.531515 run iperf3-srv_10.42.42.10(pid=26711): Launched 10:03:16.686733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:03:16.896386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:03:17.220536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26712): Launched 10:03:17.487535 run iperf3-srv_10.42.42.10(pid=26713): Launched 10:03:17.599835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:03:17.801207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:03:18.102852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Launched 10:03:18.364142 run iperf3-srv_10.42.42.10(pid=26715): Launched 10:03:18.475731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:03:18.674994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:03:18.974308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26716): Launched 10:03:19.234370 run iperf3-srv_10.42.42.10(pid=26717): Launched 10:03:19.346373 tst iperf3m4.py:8: start network... 10:03:19.545738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:20.009036 run create_hlr_db(pid=26718): Launched 10:03:20.133915 bus /gobi_6: Setting Powered False 10:03:21.196536 run create_hlr_db(pid=26718): Terminated: ok {rc=0} 10:03:21.626076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26720): Launched 10:03:21.926472 run osmo-hlr_10.42.42.2(pid=26721): Launched 10:03:22.040655 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:22.557474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26723): Launched 10:03:22.857969 run osmo-stp_10.42.42.5(pid=26724): Launched 10:03:22.971963 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:03:23.490097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26726): Launched 10:03:23.606234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:03:23.859452 run patchelf(pid=26727): Launched 10:03:24.026908 run osmo-stp_10.42.42.5(pid=26724): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26724)] 10:03:24.154674 run osmo-stp_10.42.42.5(pid=26724): stdout: | (launched: 2022-12-10_10:03:22.803330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:24.283616 run osmo-stp_10.42.42.5(pid=26724): stderr: | 20221210100322973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100322974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100322974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100322974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100322975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100322975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100322975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:24.412850 run osmo-stp_10.42.42.5(pid=26724): stdout: | (launched: 2022-12-10_10:03:22.803330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:24.535650 run osmo-stp_10.42.42.5(pid=26724): stderr: | 20221210100322973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100322974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100322974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100322974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100322975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100322975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100322975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:24.681640 run patchelf(pid=26727): Terminating (SIGINT) 10:03:24.850396 run patchelf(pid=26727): Terminated: ok {rc=0} 10:03:24.972781 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26724): Process ended prematurely: osmo-stp_10.42.42.5(pid=26724) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26724)] [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 10:03:24.982325 tst iperf3m4.py:8: Test FAILED (10.5 sec) 10:03:25.009447 run osmo-hlr_10.42.42.2(pid=26721): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26721)] 10:03:25.057105 run osmo-hlr_10.42.42.2(pid=26721): stdout: | (launched: 2022-12-10_10:03:21.871449) 10:03:25.106351 run osmo-hlr_10.42.42.2(pid=26721): stderr: | 20221210100322048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100322048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100322048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100322048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100322048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100322048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100322060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100322069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100322069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100322069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:25.155974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26710): Terminating (SIGTERM) 10:03:25.195677 run iperf3-srv_10.42.42.10(pid=26711): Terminating (SIGTERM) 10:03:25.235294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26712): Terminating (SIGTERM) 10:03:25.275225 run iperf3-srv_10.42.42.10(pid=26713): Terminating (SIGTERM) 10:03:25.314964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Terminating (SIGTERM) 10:03:25.354638 run iperf3-srv_10.42.42.10(pid=26715): Terminating (SIGTERM) 10:03:25.394150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26716): Terminating (SIGTERM) 10:03:25.433724 run iperf3-srv_10.42.42.10(pid=26717): Terminating (SIGTERM) 10:03:25.473346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26720): Terminating (SIGTERM) 10:03:25.513368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26723): Terminating (SIGTERM) 10:03:25.553146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26726): Terminating (SIGTERM) 10:03:25.592819 --- ParallelTerminationStrategy: PID 26710 died... 10:03:25.611881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26710): Terminated: ok {rc=0} 10:03:25.656201 --- ParallelTerminationStrategy: PID 26711 died... 10:03:25.674854 run iperf3-srv_10.42.42.10(pid=26711): Terminated {rc=256} 10:03:25.718900 --- ParallelTerminationStrategy: PID 26712 died... 10:03:25.737521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26712): Terminated: ok {rc=0} 10:03:25.781573 --- ParallelTerminationStrategy: PID 26713 died... 10:03:25.800151 run iperf3-srv_10.42.42.10(pid=26713): Terminated {rc=256} 10:03:25.844013 --- ParallelTerminationStrategy: PID 26714 died... 10:03:25.862599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26714): Terminated: ok {rc=0} 10:03:25.906576 --- ParallelTerminationStrategy: PID 26715 died... 10:03:25.925039 run iperf3-srv_10.42.42.10(pid=26715): Terminated {rc=256} 10:03:25.968479 --- ParallelTerminationStrategy: PID 26716 died... 10:03:25.986897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26716): Terminated: ok {rc=0} 10:03:26.030430 --- ParallelTerminationStrategy: PID 26717 died... 10:03:26.049039 run iperf3-srv_10.42.42.10(pid=26717): Terminated {rc=256} 10:03:26.092558 --- ParallelTerminationStrategy: PID 26720 died... 10:03:26.111079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26720): Terminated: ok {rc=0} 10:03:26.155000 --- ParallelTerminationStrategy: PID 26723 died... 10:03:26.173503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26723): Terminated: ok {rc=0} 10:03:26.217949 --- ParallelTerminationStrategy: PID 26726 died... 10:03:26.236650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26726): Terminated: ok {rc=0} 10:03:26.320786 bus /gobi_4: Setting Powered False 10:03:27.419141 bus /gobi_4: Setting Powered False 10:03:28.536393 bus /gobi_1: Setting Powered False 10:03:29.634184 bus /gobi_1: Setting Powered False 10:03:30.753938 bus /gobi_0: Setting Powered False 10:03:31.857578 bus /gobi_0: Setting Powered False 10:03:32.977567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 10:03:34.082961 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.094933 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:03:34.133882 tst ping.py: using LAC 27627 10:03:34.257312 tst ping.py: using RAC 87 10:03:34.385440 tst ping.py: using CellId 27627 10:03:34.509365 tst ping.py: using BVCI 27628 10:03:34.623853 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.635158 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.646454 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.657844 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.669144 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.680272 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.691693 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:34.703181 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:03:34.819778 tst ping.py:19: start network... 10:03:35.031667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:35.518592 run create_hlr_db(pid=26728): Launched 10:03:35.638129 bus /gobi_6: Setting Powered False 10:03:36.700596 run create_hlr_db(pid=26728): Terminated: ok {rc=0} 10:03:37.122019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Launched 10:03:37.416082 run osmo-hlr_10.42.42.2(pid=26731): Launched 10:03:37.528481 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:38.037968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Launched 10:03:38.332678 run osmo-stp_10.42.42.5(pid=26734): Launched 10:03:38.445282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:03:38.954717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26736): Launched 10:03:39.067518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:03:39.315921 run patchelf(pid=26737): Launched 10:03:39.480042 run osmo-stp_10.42.42.5(pid=26734): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] 10:03:39.605403 run osmo-stp_10.42.42.5(pid=26734): stdout: | (launched: 2022-12-10_10:03:38.279019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:39.732088 run osmo-stp_10.42.42.5(pid=26734): stderr: | 20221210100338448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100338448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100338448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100338449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100338449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100338449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100338449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:39.859025 run osmo-stp_10.42.42.5(pid=26734): stdout: | (launched: 2022-12-10_10:03:38.279019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:39.979925 run osmo-stp_10.42.42.5(pid=26734): stderr: | 20221210100338448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100338448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100338448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100338449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100338449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100338449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100338449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:40.123065 run patchelf(pid=26737): Terminating (SIGINT) 10:03:40.290183 run patchelf(pid=26737): Terminated: ok {rc=0} 10:03:40.410476 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26734): Process ended prematurely: osmo-stp_10.42.42.5(pid=26734) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 10:03:40.419210 tst ping.py:22: Test FAILED (6.3 sec) 10:03:40.445982 run osmo-hlr_10.42.42.2(pid=26731): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26731)] 10:03:40.494297 run osmo-hlr_10.42.42.2(pid=26731): stdout: | (launched: 2022-12-10_10:03:37.362366) 10:03:40.543977 run osmo-hlr_10.42.42.2(pid=26731): stderr: | 20221210100337540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100337540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100337540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100337540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100337540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100337541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100337552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100337561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100337561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100337561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:40.593954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Terminating (SIGTERM) 10:03:40.634089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Terminating (SIGTERM) 10:03:40.674250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26736): Terminating (SIGTERM) 10:03:40.714565 --- ParallelTerminationStrategy: PID 26730 died... 10:03:40.733867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26730): Terminated: ok {rc=0} 10:03:40.778056 --- ParallelTerminationStrategy: PID 26733 died... 10:03:40.796735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26733): Terminated: ok {rc=0} 10:03:40.840646 --- ParallelTerminationStrategy: PID 26736 died... 10:03:40.859369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26736): Terminated: ok {rc=0} 10:03:40.945136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:03:42.033490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.044741 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:03:42.082622 tst ping_idle_ping.py: using LAC 27628 10:03:42.199764 tst ping_idle_ping.py: using RAC 88 10:03:42.317643 tst ping_idle_ping.py: using CellId 27628 10:03:42.433023 tst ping_idle_ping.py: using BVCI 27629 10:03:42.540000 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.550700 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.561320 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.571887 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.582372 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.592774 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.603450 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:03:42.614575 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:03:42.727232 tst ping_idle_ping.py:24: start network... 10:03:42.925232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:43.385657 run create_hlr_db(pid=26738): Launched 10:03:43.506743 bus /gobi_6: Setting Powered False 10:03:44.567244 run create_hlr_db(pid=26738): Terminated: ok {rc=0} 10:03:45.000881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26740): Launched 10:03:45.317634 run osmo-hlr_10.42.42.2(pid=26741): Launched 10:03:45.439305 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:46.035531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26743): Launched 10:03:46.366556 run osmo-stp_10.42.42.5(pid=26744): Launched 10:03:46.557464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:03:47.296883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26746): Launched 10:03:47.419062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:03:47.686903 run patchelf(pid=26747): Launched 10:03:47.862761 run osmo-stp_10.42.42.5(pid=26744): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26744)] 10:03:47.996791 run osmo-stp_10.42.42.5(pid=26744): stdout: | (launched: 2022-12-10_10:03:46.307514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:48.133182 run osmo-stp_10.42.42.5(pid=26744): stderr: | 20221210100346639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100346640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100346640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100346640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100346641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100346641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100346641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:48.269378 run osmo-stp_10.42.42.5(pid=26744): stdout: | (launched: 2022-12-10_10:03:46.307514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:48.399428 run osmo-stp_10.42.42.5(pid=26744): stderr: | 20221210100346639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100346640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100346640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100346640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100346641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100346641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100346641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:48.553955 run patchelf(pid=26747): Terminating (SIGINT) 10:03:48.731558 run patchelf(pid=26747): Terminated: ok {rc=0} 10:03:48.859865 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26744): Process ended prematurely: osmo-stp_10.42.42.5(pid=26744) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26744)] [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 10:03:48.869632 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:03:48.897887 run osmo-hlr_10.42.42.2(pid=26741): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26741)] 10:03:48.948591 run osmo-hlr_10.42.42.2(pid=26741): stdout: | (launched: 2022-12-10_10:03:45.260489) 10:03:49.000693 run osmo-hlr_10.42.42.2(pid=26741): stderr: | 20221210100345458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100345458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100345458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100345458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100345458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100345458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100345474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100345483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100345484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100345484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:03:49.053377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26740): Terminating (SIGTERM) 10:03:49.095345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26743): Terminating (SIGTERM) 10:03:49.137468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26746): Terminating (SIGTERM) 10:03:49.179670 --- ParallelTerminationStrategy: PID 26740 died... 10:03:49.199711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26740): Terminated: ok {rc=0} 10:03:49.246629 --- ParallelTerminationStrategy: PID 26743 died... 10:03:49.266462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26743): Terminated: ok {rc=0} 10:03:49.313379 --- ParallelTerminationStrategy: PID 26746 died... 10:03:49.332876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26746): Terminated: ok {rc=0} 10:03:49.422288 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:03:50.712189 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:03:50.718030 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:03:50.738451 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:03:50.776433 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:03:50.863442 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:03:50.883660 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:03:50.921601 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:03:51.516085 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:03:51.564371 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:51.575156 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:03:51.631519 tst cs_paging_gprs_active.py: using LAC 27629 10:03:51.751210 tst cs_paging_gprs_active.py: using RAC 89 10:03:51.870231 tst cs_paging_gprs_active.py: using CellId 27629 10:03:51.990043 tst cs_paging_gprs_active.py: using BVCI 27630 10:03:52.099074 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.110008 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.120567 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.131163 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.141645 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.152120 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.163052 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.173541 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:03:52.184182 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:03:52.302437 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:03:52.421626 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:03:52.640810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:03:52.964251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26751): Launched 10:03:53.244576 run iperf3-srv_10.42.42.10(pid=26752): Launched 10:03:53.366499 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:03:53.585894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:03:53.909204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26753): Launched 10:03:54.189323 run iperf3-srv_10.42.42.10(pid=26754): Launched 10:03:54.310062 tst cs_paging_gprs_active.py:38: start network... 10:03:54.528691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:03:55.026185 run create_hlr_db(pid=26755): Launched 10:03:55.149179 bus /gobi_6: Setting Powered False 10:03:56.212504 run create_hlr_db(pid=26755): Terminated: ok {rc=0} 10:03:56.659192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26757): Launched 10:03:56.978760 run osmo-hlr_10.42.42.2(pid=26758): Launched 10:03:57.101640 run osmo-stp_10.42.42.5: Starting osmo-stp 10:03:57.659225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26760): Launched 10:03:57.979450 run osmo-stp_10.42.42.5(pid=26761): Launched 10:03:58.103061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:03:58.659046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26763): Launched 10:03:58.782725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:03:59.053587 run patchelf(pid=26764): Launched 10:03:59.233069 run osmo-stp_10.42.42.5(pid=26761): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26761)] 10:03:59.370135 run osmo-stp_10.42.42.5(pid=26761): stdout: | (launched: 2022-12-10_10:03:57.921832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:59.508809 run osmo-stp_10.42.42.5(pid=26761): stderr: | 20221210100358114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100358115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100358115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100358115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100358116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100358116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100358116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:59.647440 run osmo-stp_10.42.42.5(pid=26761): stdout: | (launched: 2022-12-10_10:03:57.921832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:03:59.779719 run osmo-stp_10.42.42.5(pid=26761): stderr: | 20221210100358114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100358115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100358115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100358115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100358116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100358116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100358116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:03:59.936376 run patchelf(pid=26764): Terminating (SIGINT) 10:04:00.118186 run patchelf(pid=26764): Terminated: ok {rc=0} 10:04:00.249767 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26761): Process ended prematurely: osmo-stp_10.42.42.5(pid=26761) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26761)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:04:00.259736 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:04:00.288576 run osmo-hlr_10.42.42.2(pid=26758): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26758)] 10:04:00.338518 run osmo-hlr_10.42.42.2(pid=26758): stdout: | (launched: 2022-12-10_10:03:56.920941) 10:04:00.390201 run osmo-hlr_10.42.42.2(pid=26758): stderr: | 20221210100357119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100357119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100357119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100357119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100357119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100357119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100357132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100357140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100357140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100357140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:00.443087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26751): Terminating (SIGTERM) 10:04:00.485139 run iperf3-srv_10.42.42.10(pid=26752): Terminating (SIGTERM) 10:04:00.527352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26753): Terminating (SIGTERM) 10:04:00.569452 run iperf3-srv_10.42.42.10(pid=26754): Terminating (SIGTERM) 10:04:00.611154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26757): Terminating (SIGTERM) 10:04:00.653435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26760): Terminating (SIGTERM) 10:04:00.695385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26763): Terminating (SIGTERM) 10:04:00.737445 --- ParallelTerminationStrategy: PID 26751 died... 10:04:00.757269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26751): Terminated: ok {rc=0} 10:04:00.803642 --- ParallelTerminationStrategy: PID 26752 died... 10:04:00.822949 run iperf3-srv_10.42.42.10(pid=26752): Terminated {rc=256} 10:04:00.869812 --- ParallelTerminationStrategy: PID 26753 died... 10:04:00.890290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26753): Terminated: ok {rc=0} 10:04:00.942177 --- ParallelTerminationStrategy: PID 26754 died... 10:04:00.961714 run iperf3-srv_10.42.42.10(pid=26754): Terminated {rc=256} 10:04:01.008164 --- ParallelTerminationStrategy: PID 26757 died... 10:04:01.028068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26757): Terminated: ok {rc=0} 10:04:01.074804 --- ParallelTerminationStrategy: PID 26760 died... 10:04:01.094633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26760): Terminated: ok {rc=0} 10:04:01.141434 --- ParallelTerminationStrategy: PID 26763 died... 10:04:01.161278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26763): Terminated: ok {rc=0} 10:04:01.249614 bus /gobi_0: Setting Powered False 10:04:02.347540 bus /gobi_0: Setting Powered False 10:04:03.463170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:04:04.609590 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:04.620857 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:04:04.684040 tst iperf3.py: using LAC 27630 10:04:04.801450 tst iperf3.py: using RAC 90 10:04:04.920271 tst iperf3.py: using CellId 27630 10:04:05.037931 tst iperf3.py: using BVCI 27631 10:04:05.147223 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.158076 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.168651 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.179767 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.190753 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.201933 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.213465 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.224514 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:05.235860 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:04:05.355845 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:04:05.573634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:05.895642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26765): Launched 10:04:06.174380 run iperf3-srv_10.42.42.10(pid=26766): Launched 10:04:06.294710 tst iperf3.py:8: start network... 10:04:06.512656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:07.009803 run create_hlr_db(pid=26767): Launched 10:04:07.132435 bus /gobi_6: Setting Powered False 10:04:08.195888 run create_hlr_db(pid=26767): Terminated: ok {rc=0} 10:04:08.643126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26769): Launched 10:04:08.963154 run osmo-hlr_10.42.42.2(pid=26770): Launched 10:04:09.085850 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:09.638312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26772): Launched 10:04:09.957576 run osmo-stp_10.42.42.5(pid=26773): Launched 10:04:10.081226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:10.637745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26776): Launched 10:04:10.761584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:11.032624 run patchelf(pid=26777): Launched 10:04:11.210731 run osmo-stp_10.42.42.5(pid=26773): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26773)] 10:04:11.347442 run osmo-stp_10.42.42.5(pid=26773): stdout: | (launched: 2022-12-10_10:04:09.900063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:11.485596 run osmo-stp_10.42.42.5(pid=26773): stderr: | 20221210100410092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100410092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100410092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100410093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100410093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100410093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100410093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:11.624489 run osmo-stp_10.42.42.5(pid=26773): stdout: | (launched: 2022-12-10_10:04:09.900063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:11.756237 run osmo-stp_10.42.42.5(pid=26773): stderr: | 20221210100410092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100410092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100410092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100410093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100410093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100410093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100410093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:11.912762 run patchelf(pid=26777): Terminating (SIGINT) 10:04:12.094010 run patchelf(pid=26777): Terminated: ok {rc=0} 10:04:12.224882 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26773): Process ended prematurely: osmo-stp_10.42.42.5(pid=26773) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26773)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 10:04:12.235037 tst iperf3.py:8: Test FAILED (7.7 sec) 10:04:12.263831 run osmo-hlr_10.42.42.2(pid=26770): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26770)] 10:04:12.313905 run osmo-hlr_10.42.42.2(pid=26770): stdout: | (launched: 2022-12-10_10:04:08.905766) 10:04:12.365695 run osmo-hlr_10.42.42.2(pid=26770): stderr: | 20221210100409101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100409101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100409101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100409101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100409101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100409101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100409114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100409124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100409124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100409124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:12.418186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26765): Terminating (SIGTERM) 10:04:12.460547 run iperf3-srv_10.42.42.10(pid=26766): Terminating (SIGTERM) 10:04:12.502373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26769): Terminating (SIGTERM) 10:04:12.544690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26772): Terminating (SIGTERM) 10:04:12.586593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26776): Terminating (SIGTERM) 10:04:12.628558 --- ParallelTerminationStrategy: PID 26765 died... 10:04:12.648454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26765): Terminated: ok {rc=0} 10:04:12.695378 --- ParallelTerminationStrategy: PID 26766 died... 10:04:12.714896 run iperf3-srv_10.42.42.10(pid=26766): Terminated {rc=256} 10:04:12.761233 --- ParallelTerminationStrategy: PID 26769 died... 10:04:12.780448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26769): Terminated: ok {rc=0} 10:04:12.826507 --- ParallelTerminationStrategy: PID 26772 died... 10:04:12.845816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26772): Terminated: ok {rc=0} 10:04:12.891780 --- ParallelTerminationStrategy: PID 26776 died... 10:04:12.911313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26776): Terminated: ok {rc=0} 10:04:13.000062 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:04:14.145208 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.156637 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:04:14.212577 tst iperf3m4.py: using LAC 27631 10:04:14.332777 tst iperf3m4.py: using RAC 91 10:04:14.451895 tst iperf3m4.py: using CellId 27631 10:04:14.571817 tst iperf3m4.py: using BVCI 27632 10:04:14.681803 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.692651 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.703189 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.713806 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.724271 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.734816 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.745659 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.756151 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:14.766910 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:04:14.886438 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:04:15.004774 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:04:15.126332 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:04:15.245628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:04:15.463332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:15.786435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26778): Launched 10:04:16.108888 run iperf3-srv_10.42.42.10(pid=26779): Launched 10:04:16.269687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:04:16.551495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:16.896905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26780): Launched 10:04:17.218409 run iperf3-srv_10.42.42.10(pid=26781): Launched 10:04:17.357770 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:04:17.558676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:17.864923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26782): Launched 10:04:18.129659 run iperf3-srv_10.42.42.10(pid=26783): Launched 10:04:18.241868 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:04:18.442918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:18.749584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26784): Launched 10:04:19.014973 run iperf3-srv_10.42.42.10(pid=26785): Launched 10:04:19.126956 tst iperf3m4.py:8: start network... 10:04:19.326833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:19.794114 run create_hlr_db(pid=26786): Launched 10:04:19.915722 bus /gobi_6: Setting Powered False 10:04:20.975902 run create_hlr_db(pid=26786): Terminated: ok {rc=0} 10:04:21.398585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26788): Launched 10:04:21.700767 run osmo-hlr_10.42.42.2(pid=26789): Launched 10:04:21.814104 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:22.332624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26791): Launched 10:04:22.634532 run osmo-stp_10.42.42.5(pid=26792): Launched 10:04:22.747305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:23.271850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26794): Launched 10:04:23.386360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:23.641709 run patchelf(pid=26795): Launched 10:04:23.807967 run osmo-stp_10.42.42.5(pid=26792): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26792)] 10:04:23.935263 run osmo-stp_10.42.42.5(pid=26792): stdout: | (launched: 2022-12-10_10:04:22.576607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:24.064074 run osmo-stp_10.42.42.5(pid=26792): stderr: | 20221210100422752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100422753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100422753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100422753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100422754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100422754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100422754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:24.192650 run osmo-stp_10.42.42.5(pid=26792): stdout: | (launched: 2022-12-10_10:04:22.576607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:24.314872 run osmo-stp_10.42.42.5(pid=26792): stderr: | 20221210100422752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100422753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100422753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100422753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100422754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100422754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100422754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:24.460054 run patchelf(pid=26795): Terminating (SIGINT) 10:04:24.629224 run patchelf(pid=26795): Terminated: ok {rc=0} 10:04:24.750933 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26792): Process ended prematurely: osmo-stp_10.42.42.5(pid=26792) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26792)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:04:24.760101 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:04:24.787414 run osmo-hlr_10.42.42.2(pid=26789): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26789)] 10:04:24.835271 run osmo-hlr_10.42.42.2(pid=26789): stdout: | (launched: 2022-12-10_10:04:21.642503) 10:04:24.885349 run osmo-hlr_10.42.42.2(pid=26789): stderr: | 20221210100421821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100421821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100421821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100421821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100421821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100421821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100421833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100421843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100421843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100421843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:24.935032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26778): Terminating (SIGTERM) 10:04:24.974910 run iperf3-srv_10.42.42.10(pid=26779): Terminating (SIGTERM) 10:04:25.014561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26780): Terminating (SIGTERM) 10:04:25.054153 run iperf3-srv_10.42.42.10(pid=26781): Terminating (SIGTERM) 10:04:25.093624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26782): Terminating (SIGTERM) 10:04:25.133424 run iperf3-srv_10.42.42.10(pid=26783): Terminating (SIGTERM) 10:04:25.173195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26784): Terminating (SIGTERM) 10:04:25.212663 run iperf3-srv_10.42.42.10(pid=26785): Terminating (SIGTERM) 10:04:25.252102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26788): Terminating (SIGTERM) 10:04:25.291757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26791): Terminating (SIGTERM) 10:04:25.331633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26794): Terminating (SIGTERM) 10:04:25.371373 --- ParallelTerminationStrategy: PID 26778 died... 10:04:25.390330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26778): Terminated: ok {rc=0} 10:04:25.434786 --- ParallelTerminationStrategy: PID 26779 died... 10:04:25.453413 run iperf3-srv_10.42.42.10(pid=26779): Terminated {rc=256} 10:04:25.496633 --- ParallelTerminationStrategy: PID 26780 died... 10:04:25.515160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26780): Terminated: ok {rc=0} 10:04:25.559718 --- ParallelTerminationStrategy: PID 26781 died... 10:04:25.578391 run iperf3-srv_10.42.42.10(pid=26781): Terminated {rc=256} 10:04:25.622193 --- ParallelTerminationStrategy: PID 26782 died... 10:04:25.640844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26782): Terminated: ok {rc=0} 10:04:25.684525 --- ParallelTerminationStrategy: PID 26783 died... 10:04:25.703032 run iperf3-srv_10.42.42.10(pid=26783): Terminated {rc=256} 10:04:25.747049 --- ParallelTerminationStrategy: PID 26784 died... 10:04:25.765627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26784): Terminated: ok {rc=0} 10:04:25.809286 --- ParallelTerminationStrategy: PID 26785 died... 10:04:25.827813 run iperf3-srv_10.42.42.10(pid=26785): Terminated {rc=256} 10:04:25.871573 --- ParallelTerminationStrategy: PID 26788 died... 10:04:25.890021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26788): Terminated: ok {rc=0} 10:04:25.933925 --- ParallelTerminationStrategy: PID 26791 died... 10:04:25.952751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26791): Terminated: ok {rc=0} 10:04:25.996534 --- ParallelTerminationStrategy: PID 26794 died... 10:04:26.015251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26794): Terminated: ok {rc=0} 10:04:26.098062 bus /gobi_4: Setting Powered False 10:04:27.195674 bus /gobi_4: Setting Powered False 10:04:28.312097 bus /gobi_1: Setting Powered False 10:04:29.409066 bus /gobi_1: Setting Powered False 10:04:30.524658 bus /gobi_0: Setting Powered False 10:04:31.623911 bus /gobi_0: Setting Powered False 10:04:32.737699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:04:33.840526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:33.852626 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:04:33.920143 tst ping.py: using LAC 27632 10:04:34.042236 tst ping.py: using RAC 92 10:04:34.164049 tst ping.py: using CellId 27632 10:04:34.285820 tst ping.py: using BVCI 27633 10:04:34.399952 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:34.411263 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:34.422458 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:34.433875 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:34.445155 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:34.456400 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:34.467876 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:34.479101 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:04:34.594561 tst ping.py:19: start network... 10:04:34.793336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:35.252247 run create_hlr_db(pid=26796): Launched 10:04:35.373085 bus /gobi_6: Setting Powered False 10:04:36.432207 run create_hlr_db(pid=26796): Terminated: ok {rc=0} 10:04:36.868056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26798): Launched 10:04:37.186665 run osmo-hlr_10.42.42.2(pid=26799): Launched 10:04:37.306876 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:37.858131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26801): Launched 10:04:38.174310 run osmo-stp_10.42.42.5(pid=26802): Launched 10:04:38.292843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:38.843868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26804): Launched 10:04:38.965270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:39.235945 run patchelf(pid=26805): Launched 10:04:39.410521 run osmo-stp_10.42.42.5(pid=26802): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26802)] 10:04:39.544381 run osmo-stp_10.42.42.5(pid=26802): stdout: | (launched: 2022-12-10_10:04:38.113791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:39.679853 run osmo-stp_10.42.42.5(pid=26802): stderr: | 20221210100438310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100438310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100438310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100438311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100438311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100438311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100438311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:39.815398 run osmo-stp_10.42.42.5(pid=26802): stdout: | (launched: 2022-12-10_10:04:38.113791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:39.944584 run osmo-stp_10.42.42.5(pid=26802): stderr: | 20221210100438310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100438310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100438310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100438311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100438311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100438311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100438311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:40.098087 run patchelf(pid=26805): Terminating (SIGINT) 10:04:40.274756 run patchelf(pid=26805): Terminated: ok {rc=0} 10:04:40.402399 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26802): Process ended prematurely: osmo-stp_10.42.42.5(pid=26802) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26802)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 10:04:40.411926 tst ping.py:22: Test FAILED (6.6 sec) 10:04:40.440490 run osmo-hlr_10.42.42.2(pid=26799): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26799)] 10:04:40.491064 run osmo-hlr_10.42.42.2(pid=26799): stdout: | (launched: 2022-12-10_10:04:37.125439) 10:04:40.543723 run osmo-hlr_10.42.42.2(pid=26799): stderr: | 20221210100437325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100437325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100437325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100437325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100437325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100437325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100437338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100437346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100437346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100437346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:40.596603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26798): Terminating (SIGTERM) 10:04:40.638917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26801): Terminating (SIGTERM) 10:04:40.681618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26804): Terminating (SIGTERM) 10:04:40.724157 --- ParallelTerminationStrategy: PID 26798 died... 10:04:40.744316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26798): Terminated: ok {rc=0} 10:04:40.791506 --- ParallelTerminationStrategy: PID 26801 died... 10:04:40.811193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26801): Terminated: ok {rc=0} 10:04:40.858170 --- ParallelTerminationStrategy: PID 26804 died... 10:04:40.877870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26804): Terminated: ok {rc=0} 10:04:40.966406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:04:42.053468 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.065417 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:04:42.124768 tst ping_idle_ping.py: using LAC 27633 10:04:42.250336 tst ping_idle_ping.py: using RAC 93 10:04:42.373840 tst ping_idle_ping.py: using CellId 27633 10:04:42.496918 tst ping_idle_ping.py: using BVCI 27634 10:04:42.613769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.625433 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.636469 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.647882 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.659128 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.670525 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.681981 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:04:42.693594 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:04:42.808921 tst ping_idle_ping.py:24: start network... 10:04:43.006471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:43.465959 run create_hlr_db(pid=26807): Launched 10:04:43.586864 bus /gobi_6: Setting Powered False 10:04:44.646152 run create_hlr_db(pid=26807): Terminated: ok {rc=0} 10:04:45.082531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26809): Launched 10:04:45.401519 run osmo-hlr_10.42.42.2(pid=26810): Launched 10:04:45.522079 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:46.108997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26812): Launched 10:04:46.418747 run osmo-stp_10.42.42.5(pid=26813): Launched 10:04:46.632250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:47.318419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26815): Launched 10:04:47.439763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:47.697702 run patchelf(pid=26816): Launched 10:04:47.873498 run osmo-stp_10.42.42.5(pid=26813): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26813)] 10:04:48.007666 run osmo-stp_10.42.42.5(pid=26813): stdout: | (launched: 2022-12-10_10:04:46.358533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:48.143865 run osmo-stp_10.42.42.5(pid=26813): stderr: | 20221210100446708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100446708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100446708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100446709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100446709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100446709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100446709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:48.279842 run osmo-stp_10.42.42.5(pid=26813): stdout: | (launched: 2022-12-10_10:04:46.358533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:48.410051 run osmo-stp_10.42.42.5(pid=26813): stderr: | 20221210100446708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100446708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100446708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100446709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100446709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100446709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100446709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:48.564575 run patchelf(pid=26816): Terminating (SIGINT) 10:04:48.742552 run patchelf(pid=26816): Terminated: ok {rc=0} 10:04:48.870954 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26813): Process ended prematurely: osmo-stp_10.42.42.5(pid=26813) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26813)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:04:48.880418 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:04:48.909350 run osmo-hlr_10.42.42.2(pid=26810): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26810)] 10:04:48.960275 run osmo-hlr_10.42.42.2(pid=26810): stdout: | (launched: 2022-12-10_10:04:45.339833) 10:04:49.012873 run osmo-hlr_10.42.42.2(pid=26810): stderr: | 20221210100445542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100445542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100445542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100445542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100445542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100445542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100445555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100445565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100445565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100445565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:04:49.066056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26809): Terminating (SIGTERM) 10:04:49.108876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26812): Terminating (SIGTERM) 10:04:49.151752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26815): Terminating (SIGTERM) 10:04:49.194928 --- ParallelTerminationStrategy: PID 26809 died... 10:04:49.215129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26809): Terminated: ok {rc=0} 10:04:49.262700 --- ParallelTerminationStrategy: PID 26812 died... 10:04:49.282621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26812): Terminated: ok {rc=0} 10:04:49.329732 --- ParallelTerminationStrategy: PID 26815 died... 10:04:49.349671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26815): Terminated: ok {rc=0} 10:04:49.438635 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:04:50.736569 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:04:50.743489 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:04:50.765324 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:04:50.806309 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:04:50.892693 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:04:50.913735 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:04:50.953193 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:04:51.552381 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:04:51.602463 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:51.613391 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:04:51.668433 tst cs_paging_gprs_active.py: using LAC 27634 10:04:51.784810 tst cs_paging_gprs_active.py: using RAC 94 10:04:51.902940 tst cs_paging_gprs_active.py: using CellId 27634 10:04:52.020771 tst cs_paging_gprs_active.py: using BVCI 27635 10:04:52.130434 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.141354 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.151862 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.162414 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.172742 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.183299 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.193976 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.204349 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:04:52.215022 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:04:52.333045 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:04:52.452830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:04:52.657176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:52.960070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26822): Launched 10:04:53.222990 run iperf3-srv_10.42.42.10(pid=26823): Launched 10:04:53.336315 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:04:53.538800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:04:53.840537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26824): Launched 10:04:54.103288 run iperf3-srv_10.42.42.10(pid=26825): Launched 10:04:54.216301 tst cs_paging_gprs_active.py:38: start network... 10:04:54.418069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:04:54.885547 run create_hlr_db(pid=26826): Launched 10:04:55.009344 bus /gobi_6: Setting Powered False 10:04:56.069690 run create_hlr_db(pid=26826): Terminated: ok {rc=0} 10:04:56.509876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26828): Launched 10:04:56.833106 run osmo-hlr_10.42.42.2(pid=26829): Launched 10:04:56.957911 run osmo-stp_10.42.42.5: Starting osmo-stp 10:04:57.517028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26831): Launched 10:04:57.839082 run osmo-stp_10.42.42.5(pid=26832): Launched 10:04:57.962858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:04:58.518385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26834): Launched 10:04:58.642425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:04:58.914005 run patchelf(pid=26835): Launched 10:04:59.093415 run osmo-stp_10.42.42.5(pid=26832): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26832)] 10:04:59.229787 run osmo-stp_10.42.42.5(pid=26832): stdout: | (launched: 2022-12-10_10:04:57.781308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:59.367908 run osmo-stp_10.42.42.5(pid=26832): stderr: | 20221210100457972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100457972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100457973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100457973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100457973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100457974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100457974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:59.506012 run osmo-stp_10.42.42.5(pid=26832): stdout: | (launched: 2022-12-10_10:04:57.781308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:04:59.638921 run osmo-stp_10.42.42.5(pid=26832): stderr: | 20221210100457972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100457972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100457973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100457973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100457973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100457974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100457974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:04:59.795230 run patchelf(pid=26835): Terminating (SIGINT) 10:04:59.976166 run patchelf(pid=26835): Terminated: ok {rc=0} 10:05:00.107104 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26832): Process ended prematurely: osmo-stp_10.42.42.5(pid=26832) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26832)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:05:00.117241 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:05:00.145933 run osmo-hlr_10.42.42.2(pid=26829): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26829)] 10:05:00.196546 run osmo-hlr_10.42.42.2(pid=26829): stdout: | (launched: 2022-12-10_10:04:56.775402) 10:05:00.248323 run osmo-hlr_10.42.42.2(pid=26829): stderr: | 20221210100456973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100456973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100456973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100456973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100456973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100456973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100456985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100456993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100456994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100456994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:00.300628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26822): Terminating (SIGTERM) 10:05:00.342865 run iperf3-srv_10.42.42.10(pid=26823): Terminating (SIGTERM) 10:05:00.384745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26824): Terminating (SIGTERM) 10:05:00.426894 run iperf3-srv_10.42.42.10(pid=26825): Terminating (SIGTERM) 10:05:00.468778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26828): Terminating (SIGTERM) 10:05:00.511039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26831): Terminating (SIGTERM) 10:05:00.553153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26834): Terminating (SIGTERM) 10:05:00.594973 --- ParallelTerminationStrategy: PID 26822 died... 10:05:00.615160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26822): Terminated: ok {rc=0} 10:05:00.661549 --- ParallelTerminationStrategy: PID 26823 died... 10:05:00.680664 run iperf3-srv_10.42.42.10(pid=26823): Terminated {rc=256} 10:05:00.726773 --- ParallelTerminationStrategy: PID 26824 died... 10:05:00.746047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26824): Terminated: ok {rc=0} 10:05:00.792169 --- ParallelTerminationStrategy: PID 26825 died... 10:05:00.811510 run iperf3-srv_10.42.42.10(pid=26825): Terminated {rc=256} 10:05:00.873650 --- ParallelTerminationStrategy: PID 26828 died... 10:05:00.897217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26828): Terminated: ok {rc=0} 10:05:00.944067 --- ParallelTerminationStrategy: PID 26831 died... 10:05:00.963765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26831): Terminated: ok {rc=0} 10:05:01.010723 --- ParallelTerminationStrategy: PID 26834 died... 10:05:01.030241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26834): Terminated: ok {rc=0} 10:05:01.129429 bus /gobi_0: Setting Powered False 10:05:02.242120 bus /gobi_0: Setting Powered False 10:05:03.359383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:05:04.508768 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:04.520658 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:05:04.582893 tst iperf3.py: using LAC 27635 10:05:04.708768 tst iperf3.py: using RAC 95 10:05:04.835007 tst iperf3.py: using CellId 27635 10:05:04.953693 tst iperf3.py: using BVCI 27636 10:05:05.072729 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.084279 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.095515 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.107032 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.118392 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.129811 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.141467 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.152631 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:05.164104 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:05:05.280477 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:05:05.482932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:05.783761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26839): Launched 10:05:06.046472 run iperf3-srv_10.42.42.10(pid=26840): Launched 10:05:06.159466 tst iperf3.py:8: start network... 10:05:06.360399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:06.828367 run create_hlr_db(pid=26841): Launched 10:05:06.952348 bus /gobi_6: Setting Powered False 10:05:08.012354 run create_hlr_db(pid=26841): Terminated: ok {rc=0} 10:05:08.432525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26843): Launched 10:05:08.733466 run osmo-hlr_10.42.42.2(pid=26844): Launched 10:05:08.849970 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:09.376487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26846): Launched 10:05:09.676791 run osmo-stp_10.42.42.5(pid=26847): Launched 10:05:09.792319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:10.313586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26849): Launched 10:05:10.429833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:10.684405 run patchelf(pid=26850): Launched 10:05:10.852237 run osmo-stp_10.42.42.5(pid=26847): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26847)] 10:05:10.980802 run osmo-stp_10.42.42.5(pid=26847): stdout: | (launched: 2022-12-10_10:05:09.622531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:11.110280 run osmo-stp_10.42.42.5(pid=26847): stderr: | 20221210100509790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100509790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100509791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100509791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100509793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100509794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100509794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:11.239859 run osmo-stp_10.42.42.5(pid=26847): stdout: | (launched: 2022-12-10_10:05:09.622531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:11.363165 run osmo-stp_10.42.42.5(pid=26847): stderr: | 20221210100509790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100509790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100509791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100509791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100509793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100509794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100509794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:11.509108 run patchelf(pid=26850): Terminating (SIGINT) 10:05:11.678614 run patchelf(pid=26850): Terminated: ok {rc=0} 10:05:11.801184 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26847): Process ended prematurely: osmo-stp_10.42.42.5(pid=26847) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26847)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 10:05:11.810537 tst iperf3.py:8: Test FAILED (7.3 sec) 10:05:11.837409 run osmo-hlr_10.42.42.2(pid=26844): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26844)] 10:05:11.884495 run osmo-hlr_10.42.42.2(pid=26844): stdout: | (launched: 2022-12-10_10:05:08.679011) 10:05:11.933387 run osmo-hlr_10.42.42.2(pid=26844): stderr: | 20221210100508855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100508855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100508855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100508855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100508855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100508856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100508868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100508877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100508877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100508877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:11.982792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26839): Terminating (SIGTERM) 10:05:12.022210 run iperf3-srv_10.42.42.10(pid=26840): Terminating (SIGTERM) 10:05:12.061591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26843): Terminating (SIGTERM) 10:05:12.100701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26846): Terminating (SIGTERM) 10:05:12.139898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26849): Terminating (SIGTERM) 10:05:12.179216 --- ParallelTerminationStrategy: PID 26839 died... 10:05:12.197981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26839): Terminated: ok {rc=0} 10:05:12.241788 --- ParallelTerminationStrategy: PID 26840 died... 10:05:12.260262 run iperf3-srv_10.42.42.10(pid=26840): Terminated {rc=256} 10:05:12.303750 --- ParallelTerminationStrategy: PID 26843 died... 10:05:12.322111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26843): Terminated: ok {rc=0} 10:05:12.365336 --- ParallelTerminationStrategy: PID 26846 died... 10:05:12.383626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26846): Terminated: ok {rc=0} 10:05:12.427114 --- ParallelTerminationStrategy: PID 26849 died... 10:05:12.445627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26849): Terminated: ok {rc=0} 10:05:12.529438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:05:13.678635 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:13.690748 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:05:13.752105 tst iperf3m4.py: using LAC 27636 10:05:13.879831 tst iperf3m4.py: using RAC 96 10:05:14.006786 tst iperf3m4.py: using CellId 27636 10:05:14.134550 tst iperf3m4.py: using BVCI 27637 10:05:14.251971 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.263620 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.274739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.288394 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.299549 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.310761 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.322068 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.332921 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:14.344465 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:05:14.462416 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:05:14.582599 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:05:14.700541 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:05:14.817945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:05:15.021628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:15.325199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26851): Launched 10:05:15.588819 run iperf3-srv_10.42.42.10(pid=26852): Launched 10:05:15.703070 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:05:15.938968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:16.258681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26853): Launched 10:05:16.538906 run iperf3-srv_10.42.42.10(pid=26854): Launched 10:05:16.677439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:05:16.883948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:17.199355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26855): Launched 10:05:17.480579 run iperf3-srv_10.42.42.10(pid=26856): Launched 10:05:17.603076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:05:17.820762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:05:18.142681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26857): Launched 10:05:18.422984 run iperf3-srv_10.42.42.10(pid=26858): Launched 10:05:18.544444 tst iperf3m4.py:8: start network... 10:05:18.761513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:19.261503 run create_hlr_db(pid=26859): Launched 10:05:19.385481 bus /gobi_6: Setting Powered False 10:05:20.449808 run create_hlr_db(pid=26859): Terminated: ok {rc=0} 10:05:20.897805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26861): Launched 10:05:21.219312 run osmo-hlr_10.42.42.2(pid=26862): Launched 10:05:21.343014 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:21.868345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26864): Launched 10:05:22.170571 run osmo-stp_10.42.42.5(pid=26865): Launched 10:05:22.285893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:22.807794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26867): Launched 10:05:22.924192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:23.178718 run patchelf(pid=26868): Launched 10:05:23.347557 run osmo-stp_10.42.42.5(pid=26865): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26865)] 10:05:23.475484 run osmo-stp_10.42.42.5(pid=26865): stdout: | (launched: 2022-12-10_10:05:22.115617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:23.604773 run osmo-stp_10.42.42.5(pid=26865): stderr: | 20221210100522286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100522287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100522287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100522288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100522288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100522288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100522288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:23.734425 run osmo-stp_10.42.42.5(pid=26865): stdout: | (launched: 2022-12-10_10:05:22.115617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:23.857623 run osmo-stp_10.42.42.5(pid=26865): stderr: | 20221210100522286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100522287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100522287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100522288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100522288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100522288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100522288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:24.003856 run patchelf(pid=26868): Terminating (SIGINT) 10:05:24.173699 run patchelf(pid=26868): Terminated: ok {rc=0} 10:05:24.295580 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26865): Process ended prematurely: osmo-stp_10.42.42.5(pid=26865) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26865)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:05:24.304933 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:05:24.332584 run osmo-hlr_10.42.42.2(pid=26862): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26862)] 10:05:24.380758 run osmo-hlr_10.42.42.2(pid=26862): stdout: | (launched: 2022-12-10_10:05:21.161532) 10:05:24.430424 run osmo-hlr_10.42.42.2(pid=26862): stderr: | 20221210100521362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100521362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100521362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100521362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100521362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100521362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100521375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100521383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100521383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100521383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:24.480434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26851): Terminating (SIGTERM) 10:05:24.520329 run iperf3-srv_10.42.42.10(pid=26852): Terminating (SIGTERM) 10:05:24.560257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26853): Terminating (SIGTERM) 10:05:24.600031 run iperf3-srv_10.42.42.10(pid=26854): Terminating (SIGTERM) 10:05:24.639909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26855): Terminating (SIGTERM) 10:05:24.680302 run iperf3-srv_10.42.42.10(pid=26856): Terminating (SIGTERM) 10:05:24.719847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26857): Terminating (SIGTERM) 10:05:24.759605 run iperf3-srv_10.42.42.10(pid=26858): Terminating (SIGTERM) 10:05:24.799089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26861): Terminating (SIGTERM) 10:05:24.838869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26864): Terminating (SIGTERM) 10:05:24.878567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26867): Terminating (SIGTERM) 10:05:24.918375 --- ParallelTerminationStrategy: PID 26851 died... 10:05:24.937431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26851): Terminated: ok {rc=0} 10:05:24.981477 --- ParallelTerminationStrategy: PID 26852 died... 10:05:24.999862 run iperf3-srv_10.42.42.10(pid=26852): Terminated {rc=256} 10:05:25.043579 --- ParallelTerminationStrategy: PID 26853 died... 10:05:25.062293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26853): Terminated: ok {rc=0} 10:05:25.106954 --- ParallelTerminationStrategy: PID 26854 died... 10:05:25.125426 run iperf3-srv_10.42.42.10(pid=26854): Terminated {rc=256} 10:05:25.169468 --- ParallelTerminationStrategy: PID 26855 died... 10:05:25.187958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26855): Terminated: ok {rc=0} 10:05:25.231710 --- ParallelTerminationStrategy: PID 26856 died... 10:05:25.250235 run iperf3-srv_10.42.42.10(pid=26856): Terminated {rc=256} 10:05:25.294012 --- ParallelTerminationStrategy: PID 26857 died... 10:05:25.312619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26857): Terminated: ok {rc=0} 10:05:25.356915 --- ParallelTerminationStrategy: PID 26858 died... 10:05:25.375946 run iperf3-srv_10.42.42.10(pid=26858): Terminated {rc=256} 10:05:25.419724 --- ParallelTerminationStrategy: PID 26861 died... 10:05:25.438557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26861): Terminated: ok {rc=0} 10:05:25.483019 --- ParallelTerminationStrategy: PID 26864 died... 10:05:25.501612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26864): Terminated: ok {rc=0} 10:05:25.545365 --- ParallelTerminationStrategy: PID 26867 died... 10:05:25.563991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26867): Terminated: ok {rc=0} 10:05:25.646867 bus /gobi_4: Setting Powered False 10:05:26.745759 bus /gobi_4: Setting Powered False 10:05:27.865217 bus /gobi_1: Setting Powered False 10:05:28.964485 bus /gobi_1: Setting Powered False 10:05:30.076240 bus /gobi_0: Setting Powered False 10:05:31.173110 bus /gobi_0: Setting Powered False 10:05:32.286855 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:05:33.389615 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:33.401781 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:05:33.461293 tst ping.py: using LAC 27637 10:05:33.586579 tst ping.py: using RAC 97 10:05:33.703332 tst ping.py: using CellId 27637 10:05:33.828466 tst ping.py: using BVCI 27638 10:05:33.943862 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:33.955445 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:33.966846 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:33.978210 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:33.989604 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:34.001151 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:34.012586 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:34.024411 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:05:34.140710 tst ping.py:19: start network... 10:05:34.339056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:34.796893 run create_hlr_db(pid=26869): Launched 10:05:34.918435 bus /gobi_6: Setting Powered False 10:05:35.978301 run create_hlr_db(pid=26869): Terminated: ok {rc=0} 10:05:36.412500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26871): Launched 10:05:36.730103 run osmo-hlr_10.42.42.2(pid=26872): Launched 10:05:36.851256 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:37.405867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26874): Launched 10:05:37.723603 run osmo-stp_10.42.42.5(pid=26875): Launched 10:05:37.844927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:38.394947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26877): Launched 10:05:38.518729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:38.785719 run patchelf(pid=26878): Launched 10:05:38.962608 run osmo-stp_10.42.42.5(pid=26875): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26875)] 10:05:39.096685 run osmo-stp_10.42.42.5(pid=26875): stdout: | (launched: 2022-12-10_10:05:37.666238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:39.233447 run osmo-stp_10.42.42.5(pid=26875): stderr: | 20221210100537859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100537859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100537859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100537860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100537860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100537860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100537860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:39.369620 run osmo-stp_10.42.42.5(pid=26875): stdout: | (launched: 2022-12-10_10:05:37.666238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:39.499840 run osmo-stp_10.42.42.5(pid=26875): stderr: | 20221210100537859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100537859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100537859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100537860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100537860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100537860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100537860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:39.654407 run patchelf(pid=26878): Terminating (SIGINT) 10:05:39.831274 run patchelf(pid=26878): Terminated: ok {rc=0} 10:05:39.961754 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26875): Process ended prematurely: osmo-stp_10.42.42.5(pid=26875) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26875)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 10:05:39.970788 tst ping.py:22: Test FAILED (6.6 sec) 10:05:39.997944 run osmo-hlr_10.42.42.2(pid=26872): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26872)] 10:05:40.045957 run osmo-hlr_10.42.42.2(pid=26872): stdout: | (launched: 2022-12-10_10:05:36.673443) 10:05:40.095948 run osmo-hlr_10.42.42.2(pid=26872): stderr: | 20221210100536869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100536869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100536869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100536869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100536869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100536869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100536881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100536889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100536889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100536890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:40.146322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26871): Terminating (SIGTERM) 10:05:40.186874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26874): Terminating (SIGTERM) 10:05:40.227180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26877): Terminating (SIGTERM) 10:05:40.267264 --- ParallelTerminationStrategy: PID 26871 died... 10:05:40.286419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26871): Terminated: ok {rc=0} 10:05:40.330718 --- ParallelTerminationStrategy: PID 26874 died... 10:05:40.349621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26874): Terminated: ok {rc=0} 10:05:40.393709 --- ParallelTerminationStrategy: PID 26877 died... 10:05:40.412535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26877): Terminated: ok {rc=0} 10:05:40.499289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:05:41.589322 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:41.601384 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:05:41.660300 tst ping_idle_ping.py: using LAC 27638 10:05:41.779573 tst ping_idle_ping.py: using RAC 98 10:05:41.896320 tst ping_idle_ping.py: using CellId 27638 10:05:42.015544 tst ping_idle_ping.py: using BVCI 27639 10:05:42.125545 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:42.136529 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:42.147278 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:42.158196 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:42.169038 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:42.179885 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:42.190927 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:05:42.201893 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:05:42.320602 tst ping_idle_ping.py:24: start network... 10:05:42.535112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:43.032712 run create_hlr_db(pid=26879): Launched 10:05:43.154860 bus /gobi_6: Setting Powered False 10:05:44.217225 run create_hlr_db(pid=26879): Terminated: ok {rc=0} 10:05:44.642788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26881): Launched 10:05:44.941075 run osmo-hlr_10.42.42.2(pid=26882): Launched 10:05:45.055231 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:45.572718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26884): Launched 10:05:45.886010 run osmo-stp_10.42.42.5(pid=26885): Launched 10:05:46.022806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:46.824396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26887): Launched 10:05:46.954531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:47.239236 run patchelf(pid=26888): Launched 10:05:47.426059 run osmo-stp_10.42.42.5(pid=26885): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26885)] 10:05:47.562436 run osmo-stp_10.42.42.5(pid=26885): stdout: | (launched: 2022-12-10_10:05:45.816655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:47.699769 run osmo-stp_10.42.42.5(pid=26885): stderr: | 20221210100546157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100546158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100546158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100546160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100546161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100546161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100546161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:47.837585 run osmo-stp_10.42.42.5(pid=26885): stdout: | (launched: 2022-12-10_10:05:45.816655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:47.968543 run osmo-stp_10.42.42.5(pid=26885): stderr: | 20221210100546157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100546158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100546158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100546160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100546161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100546161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100546161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:48.123945 run patchelf(pid=26888): Terminating (SIGINT) 10:05:48.302631 run patchelf(pid=26888): Terminated: ok {rc=0} 10:05:48.431578 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26885): Process ended prematurely: osmo-stp_10.42.42.5(pid=26885) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26885)] [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:05:48.441336 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:05:48.470029 run osmo-hlr_10.42.42.2(pid=26882): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26882)] 10:05:48.520450 run osmo-hlr_10.42.42.2(pid=26882): stdout: | (launched: 2022-12-10_10:05:44.886980) 10:05:48.572887 run osmo-hlr_10.42.42.2(pid=26882): stderr: | 20221210100545063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100545063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100545063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100545063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100545063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100545063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100545075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100545086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100545086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100545086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:48.625668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26881): Terminating (SIGTERM) 10:05:48.667704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26884): Terminating (SIGTERM) 10:05:48.709973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26887): Terminating (SIGTERM) 10:05:48.752473 --- ParallelTerminationStrategy: PID 26881 died... 10:05:48.772532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26881): Terminated: ok {rc=0} 10:05:48.819670 --- ParallelTerminationStrategy: PID 26884 died... 10:05:48.839125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26884): Terminated: ok {rc=0} 10:05:48.886152 --- ParallelTerminationStrategy: PID 26887 died... 10:05:48.905806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26887): Terminated: ok {rc=0} 10:05:48.993990 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:05:50.280479 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:05:50.287080 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:05:50.307646 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:05:50.342542 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:05:50.394896 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:05:50.415345 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:05:50.449389 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:05:51.007522 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:05:51.012637 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.024153 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:05:51.079528 tst switch_tch_pdch.py: using LAC 27639 10:05:51.196832 tst switch_tch_pdch.py: using RAC 99 10:05:51.313336 tst switch_tch_pdch.py: using CellId 27639 10:05:51.428467 tst switch_tch_pdch.py: using BVCI 27640 10:05:51.534726 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.545960 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.556766 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.567872 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.578682 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.590174 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.601568 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:05:51.612512 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:05:51.727455 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:05:51.844107 tst switch_tch_pdch.py:51: start network... 10:05:52.042023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:05:52.498473 run create_hlr_db(pid=26892): Launched 10:05:52.619972 bus /gobi_6: Setting Powered False 10:05:53.679833 run create_hlr_db(pid=26892): Terminated: ok {rc=0} 10:05:54.112696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26894): Launched 10:05:54.428153 run osmo-hlr_10.42.42.2(pid=26895): Launched 10:05:54.549867 run osmo-stp_10.42.42.5: Starting osmo-stp 10:05:55.097489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26897): Launched 10:05:55.413715 run osmo-stp_10.42.42.5(pid=26898): Launched 10:05:55.534972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:05:56.083766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26900): Launched 10:05:56.203626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:05:56.453713 run patchelf(pid=26901): Launched 10:05:56.619933 run osmo-stp_10.42.42.5(pid=26898): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26898)] 10:05:56.745867 run osmo-stp_10.42.42.5(pid=26898): stdout: | (launched: 2022-12-10_10:05:55.356722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:56.873843 run osmo-stp_10.42.42.5(pid=26898): stderr: | 20221210100555547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100555547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100555547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100555547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100555548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100555548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100555548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:57.001526 run osmo-stp_10.42.42.5(pid=26898): stdout: | (launched: 2022-12-10_10:05:55.356722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:05:57.123614 run osmo-stp_10.42.42.5(pid=26898): stderr: | 20221210100555547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100555547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100555547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100555547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100555548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100555548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100555548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:05:57.268099 run patchelf(pid=26901): Terminating (SIGINT) 10:05:57.435679 run patchelf(pid=26901): Terminated: ok {rc=0} 10:05:57.555957 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26898): Process ended prematurely: osmo-stp_10.42.42.5(pid=26898) [trial-2373↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26898)] [trial-2373↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:05:57.564638 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 10:05:57.591174 run osmo-hlr_10.42.42.2(pid=26895): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26895)] 10:05:57.638348 run osmo-hlr_10.42.42.2(pid=26895): stdout: | (launched: 2022-12-10_10:05:54.371624) 10:05:57.686950 run osmo-hlr_10.42.42.2(pid=26895): stderr: | 20221210100554566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100554566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100554566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100554566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100554566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100554567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100554578 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100554586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100554587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100554587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:05:57.736032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26894): Terminating (SIGTERM) 10:05:57.775536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26897): Terminating (SIGTERM) 10:05:57.814988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26900): Terminating (SIGTERM) 10:05:57.854570 --- ParallelTerminationStrategy: PID 26894 died... 10:05:57.873489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26894): Terminated: ok {rc=0} 10:05:57.916930 --- ParallelTerminationStrategy: PID 26897 died... 10:05:57.935254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26897): Terminated: ok {rc=0} 10:05:57.978688 --- ParallelTerminationStrategy: PID 26900 died... 10:05:57.997241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26900): Terminated: ok {rc=0} 10:05:58.080529 bus /gobi_0: Setting Powered False 10:05:59.177349 bus /gobi_0: Setting Powered False 10:06:00.291887 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:06:01.573961 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:01.584268 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:06:01.606130 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:06:01.641547 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:06:01.693858 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:06:01.716915 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:06:01.757210 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:06:02.317173 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:06:02.322561 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.334086 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:06:02.393168 tst switch_tch_pdch.py: using LAC 27640 10:06:02.517359 tst switch_tch_pdch.py: using RAC 100 10:06:02.643136 tst switch_tch_pdch.py: using CellId 27640 10:06:02.766470 tst switch_tch_pdch.py: using BVCI 27641 10:06:02.882641 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.894018 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.905076 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.916437 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.927732 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.939069 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.950575 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:06:02.961886 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:06:03.076608 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:06:03.193934 tst switch_tch_pdch.py:51: start network... 10:06:03.407339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:03.868039 run create_hlr_db(pid=26905): Launched 10:06:03.988447 bus /gobi_6: Setting Powered False 10:06:05.051857 run create_hlr_db(pid=26905): Terminated: ok {rc=0} 10:06:05.451165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26907): Launched 10:06:05.747175 run osmo-hlr_10.42.42.2(pid=26908): Launched 10:06:05.860115 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:06.343561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26910): Launched 10:06:06.640707 run osmo-stp_10.42.42.5(pid=26911): Launched 10:06:06.753758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:06:07.239942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26913): Launched 10:06:07.353930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:06:07.604095 run patchelf(pid=26914): Launched 10:06:07.769418 run osmo-stp_10.42.42.5(pid=26911): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26911)] 10:06:07.894880 run osmo-stp_10.42.42.5(pid=26911): stdout: | (launched: 2022-12-10_10:06:06.586982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:08.021600 run osmo-stp_10.42.42.5(pid=26911): stderr: | 20221210100606756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100606756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100606756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100606757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100606759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100606759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100606759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:08.148448 run osmo-stp_10.42.42.5(pid=26911): stdout: | (launched: 2022-12-10_10:06:06.586982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:08.269458 run osmo-stp_10.42.42.5(pid=26911): stderr: | 20221210100606756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100606756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100606756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100606757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100606759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100606759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100606759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:08.413105 run patchelf(pid=26914): Terminating (SIGINT) 10:06:08.578499 run patchelf(pid=26914): Terminated: ok {rc=0} 10:06:08.698041 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26911): Process ended prematurely: osmo-stp_10.42.42.5(pid=26911) [trial-2373↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26911)] [trial-2373↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:06:08.706815 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 10:06:08.733147 run osmo-hlr_10.42.42.2(pid=26908): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26908)] 10:06:08.780112 run osmo-hlr_10.42.42.2(pid=26908): stdout: | (launched: 2022-12-10_10:06:05.693576) 10:06:08.829253 run osmo-hlr_10.42.42.2(pid=26908): stderr: | 20221210100605869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100605869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100605869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100605869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100605869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100605869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100605881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100605890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100605890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100605890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:08.878634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26907): Terminating (SIGTERM) 10:06:08.918443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26910): Terminating (SIGTERM) 10:06:08.957786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26913): Terminating (SIGTERM) 10:06:08.997548 --- ParallelTerminationStrategy: PID 26907 died... 10:06:09.016453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26907): Terminated: ok {rc=0} 10:06:09.060262 --- ParallelTerminationStrategy: PID 26910 died... 10:06:09.078822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26910): Terminated: ok {rc=0} 10:06:09.122924 --- ParallelTerminationStrategy: PID 26913 died... 10:06:09.141542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26913): Terminated: ok {rc=0} 10:06:09.226776 bus /gobi_0: Setting Powered False 10:06:10.326720 bus /gobi_0: Setting Powered False 10:06:11.440138 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_sms:trx-b200 --------------------------------------------------------------------- 10:06:12.682413 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:12.687395 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:06:12.722083 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:06:12.729111 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:06:12.779958 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:06:12.813997 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:06:12.820910 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:06:13.365367 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:06:13.370437 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 10:06:13.382042 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 10:06:13.432321 tst mo_mt_sms.py: using LAC 27641 10:06:13.557309 tst mo_mt_sms.py: using RAC 101 10:06:13.689288 tst mo_mt_sms.py: using CellId 27641 10:06:13.822430 tst mo_mt_sms.py: using BVCI 27642 10:06:13.939568 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:06:14.053210 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 10:06:14.165926 tst mo_mt_sms.py:9: start nitb and bts... 10:06:14.366061 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:06:14.972336 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26918): Launched 10:06:15.270228 run osmo-nitb_10.42.42.2(pid=26919): Launched 10:06:15.435773 run osmo-nitb_10.42.42.2(pid=26919): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26919)] 10:06:15.570651 run osmo-nitb_10.42.42.2(pid=26919): stdout: | (launched: 2022-12-10_10:06:15.216261) 10:06:15.706675 run osmo-nitb_10.42.42.2(pid=26919): stderr: | (launched: 2022-12-10_10:06:15.260468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:06:15.856750 run osmo-nitb_10.42.42.2(pid=26919): stdout: | (launched: 2022-12-10_10:06:15.216261) 10:06:16.010742 run osmo-nitb_10.42.42.2(pid=26919): stderr: | (launched: 2022-12-10_10:06:15.260468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26919): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26919) [trial-2373↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26919)] 10:06:16.383080 tst osmo-nitb_10.42.42.2(pid=26919): stdout: | (launched: 2022-12-10_10:06:15.216261) 10:06:16.512672 tst osmo-nitb_10.42.42.2(pid=26919): stderr: | (launched: 2022-12-10_10:06:15.260468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:06:16.663533 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26919): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26919) [trial-2373↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26919)] [trial-2373↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 10:06:16.672296 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:06:16.679451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26918): Terminating (SIGTERM) 10:06:16.889836 --- ParallelTerminationStrategy: PID 26918 died... 10:06:16.914347 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26918): Terminated: ok {rc=0} 10:06:17.003874 bus /sierra_3: Setting Powered False 10:06:18.100245 bus /sierra_3: Setting Powered False 10:06:19.216465 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:trx-b200 --------------------------------------------------------------------- 10:06:20.413617 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:20.417583 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 10:06:20.451006 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:06:20.478576 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 10:06:20.531476 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 10:06:20.566760 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:06:20.594352 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 10:06:21.139958 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 10:06:21.145079 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:21.155937 tst sms:trx-b200: Using 1 x bts (candidates: 1) 10:06:21.206669 tst mo_mt_sms.py: using LAC 27642 10:06:21.335057 tst mo_mt_sms.py: using RAC 102 10:06:21.461356 tst mo_mt_sms.py: using CellId 27642 10:06:21.587013 tst mo_mt_sms.py: using BVCI 27643 10:06:21.695776 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:21.706553 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:21.717356 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:21.727964 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:21.738734 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:21.749546 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:06:21.866587 tst sms:trx-b200: Using 1 x modem (candidates: 2) 10:06:22.001144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:22.492429 run create_hlr_db(pid=26923): Launched 10:06:22.614892 bus /sierra_2: Setting Powered False 10:06:23.678183 run create_hlr_db(pid=26923): Terminated: ok {rc=0} 10:06:24.103034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26925): Launched 10:06:24.399668 run osmo-hlr_10.42.42.2(pid=26926): Launched 10:06:24.513485 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:25.037513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26928): Launched 10:06:25.334431 run osmo-stp_10.42.42.5(pid=26929): Launched 10:06:25.447557 run osmo-msc_10.42.42.6: Starting osmo-msc 10:06:25.984101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26931): Launched 10:06:26.281008 run osmo-msc_10.42.42.6(pid=26932): Launched 10:06:26.447249 run osmo-stp_10.42.42.5(pid=26929): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26929)] 10:06:26.572742 run osmo-stp_10.42.42.5(pid=26929): stdout: | (launched: 2022-12-10_10:06:25.280652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:26.698578 run osmo-stp_10.42.42.5(pid=26929): stderr: | 20221210100625451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100625451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100625451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100625453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100625453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100625453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100625453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:26.822337 run osmo-stp_10.42.42.5(pid=26929): stdout: | (launched: 2022-12-10_10:06:25.280652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:26.941087 run osmo-stp_10.42.42.5(pid=26929): stderr: | 20221210100625451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100625451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100625451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100625453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100625453 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100625453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100625453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:27.082622 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26929): Process ended prematurely: osmo-stp_10.42.42.5(pid=26929) [trial-2373↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26929)] [trial-2373↪sms:trx-b200↪mo_mt_sms.py:16] 10:06:27.090807 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 10:06:27.117893 run osmo-hlr_10.42.42.2(pid=26926): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26926)] 10:06:27.166572 run osmo-hlr_10.42.42.2(pid=26926): stdout: | (launched: 2022-12-10_10:06:24.346117) 10:06:27.216806 run osmo-hlr_10.42.42.2(pid=26926): stderr: | 20221210100624522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100624522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100624522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100624522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100624522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100624522 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100624534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100624545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100624545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100624545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:27.286666 run osmo-msc_10.42.42.6(pid=26932): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26932)] 10:06:27.335083 run osmo-msc_10.42.42.6(pid=26932): stdout: | (launched: 2022-12-10_10:06:26.227016) 10:06:27.385113 run osmo-msc_10.42.42.6(pid=26932): stderr: | 20221210100626500 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100626500 DLGLOBAL DEBUG validating counter group 0x7eff7cfa1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100626500 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100626500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100626500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100626501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100626502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100626503 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100626503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100626503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:06:27.435648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26925): Terminating (SIGTERM) 10:06:27.476339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26928): Terminating (SIGTERM) 10:06:27.516861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26931): Terminating (SIGTERM) 10:06:27.557951 --- ParallelTerminationStrategy: PID 26925 died... 10:06:27.577513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26925): Terminated: ok {rc=0} 10:06:27.622872 --- ParallelTerminationStrategy: PID 26928 died... 10:06:27.641847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26928): Terminated: ok {rc=0} 10:06:27.687130 --- ParallelTerminationStrategy: PID 26931 died... 10:06:27.705994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26931): Terminated: ok {rc=0} 10:06:27.792377 bus /sierra_3: Setting Powered False 10:06:28.891677 bus /sierra_3: Setting Powered False 10:06:30.005422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-b200 --------------------------------------------------------------------- 10:06:31.262672 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:31.267751 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:06:31.308731 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 10:06:31.317735 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:06:31.359218 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:06:31.401266 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 10:06:31.410963 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:06:31.918019 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:06:31.924265 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 10:06:31.937779 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 10:06:31.991717 tst assert_extension.py: using LAC 27643 10:06:32.141334 tst assert_extension.py: using RAC 103 10:06:32.260190 tst assert_extension.py: using CellId 27643 10:06:32.384924 tst assert_extension.py: using BVCI 27644 10:06:32.501567 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 10:06:32.616274 tst assert_extension.py:10: start nitb and bts... 10:06:32.813879 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:06:33.417503 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26937): Launched 10:06:33.716081 run osmo-nitb_10.42.42.2(pid=26938): Launched 10:06:33.880578 run osmo-nitb_10.42.42.2(pid=26938): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26938)] 10:06:34.013654 run osmo-nitb_10.42.42.2(pid=26938): stdout: | (launched: 2022-12-10_10:06:33.661856) 10:06:34.148632 run osmo-nitb_10.42.42.2(pid=26938): stderr: | (launched: 2022-12-10_10:06:33.706251) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:06:34.283329 run osmo-nitb_10.42.42.2(pid=26938): stdout: | (launched: 2022-12-10_10:06:33.661856) 10:06:34.412318 run osmo-nitb_10.42.42.2(pid=26938): stderr: | (launched: 2022-12-10_10:06:33.706251) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26938) [trial-2373↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26938)] 10:06:34.828387 tst osmo-nitb_10.42.42.2(pid=26938): stdout: | (launched: 2022-12-10_10:06:33.661856) 10:06:34.947705 tst osmo-nitb_10.42.42.2(pid=26938): stderr: | (launched: 2022-12-10_10:06:33.706251) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:06:35.088511 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26938) [trial-2373↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26938)] [trial-2373↪nitb_ussd:trx-b200↪assert_extension.py:12] 10:06:35.097000 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:06:35.103679 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26937): Terminating (SIGTERM) 10:06:35.312390 --- ParallelTerminationStrategy: PID 26937 died... 10:06:35.334656 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26937): Terminated: ok {rc=0} 10:06:35.420254 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:trx-b200 --------------------------------------------------------------------- 10:06:36.599339 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:36.603559 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 10:06:36.637025 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:06:36.663644 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 10:06:36.698460 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 10:06:36.731601 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:06:36.758107 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 10:06:37.286765 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:trx-b200 assert_extension.py ---------------------------------------------- 10:06:37.291916 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:37.302582 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 10:06:37.349739 tst assert_extension.py: using LAC 27644 10:06:37.465758 tst assert_extension.py: using RAC 104 10:06:37.581535 tst assert_extension.py: using CellId 27644 10:06:37.711387 tst assert_extension.py: using BVCI 27645 10:06:37.827873 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:37.838851 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:37.849757 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:37.861255 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:37.872764 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 10:06:37.884251 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 10:06:37.998150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:38.458983 run create_hlr_db(pid=26942): Launched 10:06:38.581426 bus /sierra_2: Setting Powered False 10:06:39.641153 run create_hlr_db(pid=26942): Terminated: ok {rc=0} 10:06:40.075019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26944): Launched 10:06:40.393457 run osmo-hlr_10.42.42.2(pid=26945): Launched 10:06:40.515906 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:41.064638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26947): Launched 10:06:41.381509 run osmo-stp_10.42.42.5(pid=26948): Launched 10:06:41.503073 run osmo-msc_10.42.42.6: Starting osmo-msc 10:06:42.077718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26950): Launched 10:06:42.393277 run osmo-msc_10.42.42.6(pid=26951): Launched 10:06:42.571680 run osmo-stp_10.42.42.5(pid=26948): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26948)] 10:06:42.706178 run osmo-stp_10.42.42.5(pid=26948): stdout: | (launched: 2022-12-10_10:06:41.324244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:42.840670 run osmo-stp_10.42.42.5(pid=26948): stderr: | 20221210100641517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100641517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100641517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100641517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100641518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100641518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100641518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:42.974092 run osmo-stp_10.42.42.5(pid=26948): stdout: | (launched: 2022-12-10_10:06:41.324244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:43.100529 run osmo-stp_10.42.42.5(pid=26948): stderr: | 20221210100641517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100641517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100641517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100641517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100641518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100641518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100641518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:43.251393 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26948): Process ended prematurely: osmo-stp_10.42.42.5(pid=26948) [trial-2373↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26948)] [trial-2373↪ussd:trx-b200↪assert_extension.py:17] 10:06:43.260541 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:06:43.288427 run osmo-hlr_10.42.42.2(pid=26945): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26945)] 10:06:43.338964 run osmo-hlr_10.42.42.2(pid=26945): stdout: | (launched: 2022-12-10_10:06:40.335701) 10:06:43.390856 run osmo-hlr_10.42.42.2(pid=26945): stderr: | 20221210100640533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100640534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100640534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100640534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100640534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100640534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100640546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100640555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100640555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100640555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:43.463378 run osmo-msc_10.42.42.6(pid=26951): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26951)] 10:06:43.513611 run osmo-msc_10.42.42.6(pid=26951): stdout: | (launched: 2022-12-10_10:06:42.336303) 10:06:43.565529 run osmo-msc_10.42.42.6(pid=26951): stderr: | 20221210100642658 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100642658 DLGLOBAL DEBUG validating counter group 0x7fcd01b15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100642658 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100642658 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100642658 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100642658 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100642660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100642661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100642661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100642661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:06:43.618141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26944): Terminating (SIGTERM) 10:06:43.659899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26947): Terminating (SIGTERM) 10:06:43.701769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26950): Terminating (SIGTERM) 10:06:43.743982 --- ParallelTerminationStrategy: PID 26944 died... 10:06:43.763957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26944): Terminated: ok {rc=0} 10:06:43.810669 --- ParallelTerminationStrategy: PID 26947 died... 10:06:43.830037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26947): Terminated: ok {rc=0} 10:06:43.876431 --- ParallelTerminationStrategy: PID 26950 died... 10:06:43.895880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26950): Terminated: ok {rc=0} 10:06:43.983626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:06:45.202207 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:06:45.209238 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:06:45.243886 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:06:45.270976 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:06:45.321522 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:06:45.355047 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:06:45.381576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:06:45.966068 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:06:46.017651 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:46.029487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:06:46.099111 tst mo_mt_call.py: using LAC 27645 10:06:46.253821 tst mo_mt_call.py: using RAC 105 10:06:46.413528 tst mo_mt_call.py: using CellId 27645 10:06:46.535202 tst mo_mt_call.py: using BVCI 27646 10:06:46.657091 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:46.670237 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:46.683878 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:46.696600 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:46.709858 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:46.724287 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:06:46.843096 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:06:46.998281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:47.553517 run create_hlr_db(pid=26956): Launched 10:06:47.679779 bus /sierra_2: Setting Powered False 10:06:48.744056 run create_hlr_db(pid=26956): Terminated: ok {rc=0} 10:06:49.175266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26958): Launched 10:06:49.477335 run osmo-hlr_10.42.42.2(pid=26959): Launched 10:06:49.593753 run osmo-stp_10.42.42.5: Starting osmo-stp 10:06:50.114361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26961): Launched 10:06:50.415788 run osmo-stp_10.42.42.5(pid=26962): Launched 10:06:50.531325 run osmo-msc_10.42.42.6: Starting osmo-msc 10:06:51.077839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26964): Launched 10:06:51.380086 run osmo-msc_10.42.42.6(pid=26965): Launched 10:06:51.549527 run osmo-stp_10.42.42.5(pid=26962): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26962)] 10:06:51.677600 run osmo-stp_10.42.42.5(pid=26962): stdout: | (launched: 2022-12-10_10:06:50.361451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:51.806074 run osmo-stp_10.42.42.5(pid=26962): stderr: | 20221210100650531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100650531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100650532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100650532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100650533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100650533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100650533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:51.932401 run osmo-stp_10.42.42.5(pid=26962): stdout: | (launched: 2022-12-10_10:06:50.361451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:06:52.051952 run osmo-stp_10.42.42.5(pid=26962): stderr: | 20221210100650531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100650531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100650532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100650532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100650533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100650533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100650533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:06:52.195616 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26962): Process ended prematurely: osmo-stp_10.42.42.5(pid=26962) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26962)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:06:52.204562 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:06:52.231223 run osmo-hlr_10.42.42.2(pid=26959): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26959)] 10:06:52.279308 run osmo-hlr_10.42.42.2(pid=26959): stdout: | (launched: 2022-12-10_10:06:49.422771) 10:06:52.329614 run osmo-hlr_10.42.42.2(pid=26959): stderr: | 20221210100649599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100649599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100649599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100649599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100649599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100649599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100649612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100649620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100649621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100649621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:06:52.398737 run osmo-msc_10.42.42.6(pid=26965): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26965)] 10:06:52.447007 run osmo-msc_10.42.42.6(pid=26965): stdout: | (launched: 2022-12-10_10:06:51.325454) 10:06:52.497323 run osmo-msc_10.42.42.6(pid=26965): stderr: | 20221210100651600 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100651600 DLGLOBAL DEBUG validating counter group 0x7fb1b209fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100651600 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100651600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100651600 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100651601 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100651603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100651604 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100651604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100651604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:06:52.547280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26958): Terminating (SIGTERM) 10:06:52.587124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26961): Terminating (SIGTERM) 10:06:52.626938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26964): Terminating (SIGTERM) 10:06:52.666933 --- ParallelTerminationStrategy: PID 26958 died... 10:06:52.685962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26958): Terminated: ok {rc=0} 10:06:52.730644 --- ParallelTerminationStrategy: PID 26961 died... 10:06:52.749397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26961): Terminated: ok {rc=0} 10:06:52.793936 --- ParallelTerminationStrategy: PID 26964 died... 10:06:52.812765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26964): Terminated: ok {rc=0} 10:06:52.899615 bus /sierra_3: Setting Powered False 10:06:53.998884 bus /sierra_3: Setting Powered False 10:06:55.113403 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:06:56.259864 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:56.271695 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:06:56.341542 tst mo_mt_call_osmux.py: using LAC 27646 10:06:56.468731 tst mo_mt_call_osmux.py: using RAC 106 10:06:56.594761 tst mo_mt_call_osmux.py: using CellId 27646 10:06:56.727170 tst mo_mt_call_osmux.py: using BVCI 27647 10:06:56.845685 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:56.857176 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:56.868430 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:56.880067 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:56.891820 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:06:56.903322 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:06:57.018752 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:06:57.137252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:06:57.604589 run create_hlr_db(pid=26967): Launched 10:06:57.728544 bus /sierra_2: Setting Powered False 10:06:58.789186 run create_hlr_db(pid=26967): Terminated: ok {rc=0} 10:06:59.229129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26969): Launched 10:06:59.551174 run osmo-hlr_10.42.42.2(pid=26970): Launched 10:06:59.675055 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:00.233695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26972): Launched 10:07:00.556123 run osmo-stp_10.42.42.5(pid=26973): Launched 10:07:00.680680 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:01.322955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26975): Launched 10:07:01.659065 run osmo-msc_10.42.42.6(pid=26976): Launched 10:07:02.111260 run osmo-stp_10.42.42.5(pid=26973): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26973)] 10:07:02.265706 run osmo-stp_10.42.42.5(pid=26973): stdout: | (launched: 2022-12-10_10:07:00.498378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:02.400888 run osmo-stp_10.42.42.5(pid=26973): stderr: | 20221210100700693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100700693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100700693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100700694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100700694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100700694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100700694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:02.535079 run osmo-stp_10.42.42.5(pid=26973): stdout: | (launched: 2022-12-10_10:07:00.498378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:02.664345 run osmo-stp_10.42.42.5(pid=26973): stderr: | 20221210100700693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100700693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100700693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100700694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100700694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100700694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100700694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:02.817374 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26973): Process ended prematurely: osmo-stp_10.42.42.5(pid=26973) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26973)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:07:02.827112 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:07:02.855707 run osmo-hlr_10.42.42.2(pid=26970): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26970)] 10:07:02.906151 run osmo-hlr_10.42.42.2(pid=26970): stdout: | (launched: 2022-12-10_10:06:59.493826) 10:07:02.958430 run osmo-hlr_10.42.42.2(pid=26970): stderr: | 20221210100659694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100659694 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100659694 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100659694 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100659694 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100659694 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100659706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100659714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100659714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100659715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:03.031099 run osmo-msc_10.42.42.6(pid=26976): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26976)] 10:07:03.081455 run osmo-msc_10.42.42.6(pid=26976): stdout: | (launched: 2022-12-10_10:07:01.595427) 10:07:03.133469 run osmo-msc_10.42.42.6(pid=26976): stderr: | 20221210100701956 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100701956 DLGLOBAL DEBUG validating counter group 0x7f74cf620c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100701956 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100701956 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100701956 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100701956 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100701958 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100701959 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100701959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100701959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:03.186076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26969): Terminating (SIGTERM) 10:07:03.228160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26972): Terminating (SIGTERM) 10:07:03.270344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26975): Terminating (SIGTERM) 10:07:03.312809 --- ParallelTerminationStrategy: PID 26969 died... 10:07:03.332775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26969): Terminated: ok {rc=0} 10:07:03.379985 --- ParallelTerminationStrategy: PID 26972 died... 10:07:03.399550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26972): Terminated: ok {rc=0} 10:07:03.446752 --- ParallelTerminationStrategy: PID 26975 died... 10:07:03.466516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26975): Terminated: ok {rc=0} 10:07:03.555169 bus /sierra_3: Setting Powered False 10:07:04.652609 bus /sierra_3: Setting Powered False 10:07:05.768035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:07:07.021247 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:07.028256 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:07:07.062968 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:07:07.090497 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:07:07.143449 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:07:07.177798 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:07:07.205427 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:07:07.756686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:07:07.808585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:07.820129 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:07:07.893735 tst mo_mt_call.py: using LAC 27647 10:07:08.019435 tst mo_mt_call.py: using RAC 107 10:07:08.137873 tst mo_mt_call.py: using CellId 27647 10:07:08.256934 tst mo_mt_call.py: using BVCI 27648 10:07:08.366214 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:08.377238 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:08.388090 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:08.398911 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:08.409876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:08.421117 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:07:08.535287 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:07:08.649870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:09.115603 run create_hlr_db(pid=26981): Launched 10:07:09.237883 bus /sierra_2: Setting Powered False 10:07:10.298427 run create_hlr_db(pid=26981): Terminated: ok {rc=0} 10:07:10.739213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26983): Launched 10:07:11.060573 run osmo-hlr_10.42.42.2(pid=26984): Launched 10:07:11.183696 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:11.738463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26986): Launched 10:07:12.060267 run osmo-stp_10.42.42.5(pid=26987): Launched 10:07:12.183411 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:12.767041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26989): Launched 10:07:13.089755 run osmo-msc_10.42.42.6(pid=26990): Launched 10:07:13.269722 run osmo-stp_10.42.42.5(pid=26987): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26987)] 10:07:13.406137 run osmo-stp_10.42.42.5(pid=26987): stdout: | (launched: 2022-12-10_10:07:12.002434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:13.543052 run osmo-stp_10.42.42.5(pid=26987): stderr: | 20221210100712194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100712194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100712194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100712194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100712197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100712197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100712197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:13.679397 run osmo-stp_10.42.42.5(pid=26987): stdout: | (launched: 2022-12-10_10:07:12.002434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:13.807760 run osmo-stp_10.42.42.5(pid=26987): stderr: | 20221210100712194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100712194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100712194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100712194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100712197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100712197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100712197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:13.961510 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26987): Process ended prematurely: osmo-stp_10.42.42.5(pid=26987) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26987)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:07:13.971051 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:07:13.999408 run osmo-hlr_10.42.42.2(pid=26984): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26984)] 10:07:14.049882 run osmo-hlr_10.42.42.2(pid=26984): stdout: | (launched: 2022-12-10_10:07:11.002963) 10:07:14.101778 run osmo-hlr_10.42.42.2(pid=26984): stderr: | 20221210100711199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100711199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100711199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100711199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100711199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100711199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100711211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100711220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100711220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100711220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:14.174220 run osmo-msc_10.42.42.6(pid=26990): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26990)] 10:07:14.224656 run osmo-msc_10.42.42.6(pid=26990): stdout: | (launched: 2022-12-10_10:07:13.032082) 10:07:14.276601 run osmo-msc_10.42.42.6(pid=26990): stderr: | 20221210100713354 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100713354 DLGLOBAL DEBUG validating counter group 0x7f3df2364c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100713354 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100713354 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100713354 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100713354 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100713356 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100713356 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100713356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100713357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:14.329035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26983): Terminating (SIGTERM) 10:07:14.371024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26986): Terminating (SIGTERM) 10:07:14.413379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26989): Terminating (SIGTERM) 10:07:14.455650 --- ParallelTerminationStrategy: PID 26983 died... 10:07:14.475650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26983): Terminated: ok {rc=0} 10:07:14.522834 --- ParallelTerminationStrategy: PID 26986 died... 10:07:14.542329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26986): Terminated: ok {rc=0} 10:07:14.589171 --- ParallelTerminationStrategy: PID 26989 died... 10:07:14.609078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26989): Terminated: ok {rc=0} 10:07:14.697349 bus /sierra_3: Setting Powered False 10:07:15.796249 bus /sierra_3: Setting Powered False 10:07:16.934840 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:07:18.092933 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:18.104623 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:07:18.175414 tst mo_mt_call_osmux.py: using LAC 27648 10:07:18.294134 tst mo_mt_call_osmux.py: using RAC 108 10:07:18.414636 tst mo_mt_call_osmux.py: using CellId 27648 10:07:18.535510 tst mo_mt_call_osmux.py: using BVCI 27649 10:07:18.645953 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:18.656917 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:18.667765 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:18.679180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:18.690683 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:07:18.701994 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:07:18.821096 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:07:18.937843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:19.409619 run create_hlr_db(pid=26992): Launched 10:07:19.533701 bus /sierra_2: Setting Powered False 10:07:20.594227 run create_hlr_db(pid=26992): Terminated: ok {rc=0} 10:07:21.034850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26994): Launched 10:07:21.342219 run osmo-hlr_10.42.42.2(pid=26995): Launched 10:07:21.457024 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:21.973543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26997): Launched 10:07:22.276566 run osmo-stp_10.42.42.5(pid=26998): Launched 10:07:22.391172 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:22.943569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27000): Launched 10:07:23.247110 run osmo-msc_10.42.42.6(pid=27001): Launched 10:07:23.416192 run osmo-stp_10.42.42.5(pid=26998): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26998)] 10:07:23.543631 run osmo-stp_10.42.42.5(pid=26998): stdout: | (launched: 2022-12-10_10:07:22.221919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:23.671152 run osmo-stp_10.42.42.5(pid=26998): stderr: | 20221210100722392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100722392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100722392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100722393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100722393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100722393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100722393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:23.797216 run osmo-stp_10.42.42.5(pid=26998): stdout: | (launched: 2022-12-10_10:07:22.221919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:23.916917 run osmo-stp_10.42.42.5(pid=26998): stderr: | 20221210100722392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100722392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100722392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100722393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100722393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100722393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100722393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:24.061238 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26998): Process ended prematurely: osmo-stp_10.42.42.5(pid=26998) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26998)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:07:24.069958 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:07:24.096112 run osmo-hlr_10.42.42.2(pid=26995): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26995)] 10:07:24.143424 run osmo-hlr_10.42.42.2(pid=26995): stdout: | (launched: 2022-12-10_10:07:21.287387) 10:07:24.192531 run osmo-hlr_10.42.42.2(pid=26995): stderr: | 20221210100721466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100721466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100721466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100721466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100721466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100721466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100721483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100721491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100721491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100721491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:24.261421 run osmo-msc_10.42.42.6(pid=27001): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27001)] 10:07:24.308881 run osmo-msc_10.42.42.6(pid=27001): stdout: | (launched: 2022-12-10_10:07:23.192539) 10:07:24.358224 run osmo-msc_10.42.42.6(pid=27001): stderr: | 20221210100723467 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100723467 DLGLOBAL DEBUG validating counter group 0x7f88d5377c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100723467 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100723467 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100723467 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100723467 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100723469 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100723469 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100723470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100723470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:24.407696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26994): Terminating (SIGTERM) 10:07:24.447051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26997): Terminating (SIGTERM) 10:07:24.486298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27000): Terminating (SIGTERM) 10:07:24.525876 --- ParallelTerminationStrategy: PID 26994 died... 10:07:24.544805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26994): Terminated: ok {rc=0} 10:07:24.588631 --- ParallelTerminationStrategy: PID 26997 died... 10:07:24.606999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26997): Terminated: ok {rc=0} 10:07:24.650487 --- ParallelTerminationStrategy: PID 27000 died... 10:07:24.668842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27000): Terminated: ok {rc=0} 10:07:24.754562 bus /sierra_3: Setting Powered False 10:07:25.854529 bus /sierra_3: Setting Powered False 10:07:26.967399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:07:28.222854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:28.229887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:07:28.265060 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:07:28.292779 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:07:28.344011 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:07:28.377962 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:07:28.405098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:07:28.960166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:07:29.012444 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:29.024036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:07:29.095220 tst mo_mt_call.py: using LAC 27649 10:07:29.223406 tst mo_mt_call.py: using RAC 109 10:07:29.349738 tst mo_mt_call.py: using CellId 27649 10:07:29.485022 tst mo_mt_call.py: using BVCI 27650 10:07:29.602396 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:29.614407 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:29.625992 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:29.637704 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:29.649539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:29.661341 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:07:29.777331 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:07:29.891667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:30.362343 run create_hlr_db(pid=27007): Launched 10:07:30.485878 bus /sierra_2: Setting Powered False 10:07:31.565095 run create_hlr_db(pid=27007): Terminated: ok {rc=0} 10:07:32.086639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27009): Launched 10:07:32.396386 run osmo-hlr_10.42.42.2(pid=27010): Launched 10:07:32.511105 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:33.031961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27012): Launched 10:07:33.333703 run osmo-stp_10.42.42.5(pid=27013): Launched 10:07:33.450505 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:33.996920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27015): Launched 10:07:34.299128 run osmo-msc_10.42.42.6(pid=27016): Launched 10:07:34.467642 run osmo-stp_10.42.42.5(pid=27013): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27013)] 10:07:34.594996 run osmo-stp_10.42.42.5(pid=27013): stdout: | (launched: 2022-12-10_10:07:33.279274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:34.722813 run osmo-stp_10.42.42.5(pid=27013): stderr: | 20221210100733449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100733449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100733450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100733450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100733450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100733451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100733451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:34.848622 run osmo-stp_10.42.42.5(pid=27013): stdout: | (launched: 2022-12-10_10:07:33.279274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:34.968405 run osmo-stp_10.42.42.5(pid=27013): stderr: | 20221210100733449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100733449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100733450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100733450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100733450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100733451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100733451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:35.111858 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27013): Process ended prematurely: osmo-stp_10.42.42.5(pid=27013) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27013)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:07:35.120615 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:07:35.146945 run osmo-hlr_10.42.42.2(pid=27010): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27010)] 10:07:35.194511 run osmo-hlr_10.42.42.2(pid=27010): stdout: | (launched: 2022-12-10_10:07:32.341469) 10:07:35.243647 run osmo-hlr_10.42.42.2(pid=27010): stderr: | 20221210100732521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100732521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100732521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100732521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100732521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100732521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100732537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100732546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100732547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100732547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:35.312368 run osmo-msc_10.42.42.6(pid=27016): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27016)] 10:07:35.359975 run osmo-msc_10.42.42.6(pid=27016): stdout: | (launched: 2022-12-10_10:07:34.244606) 10:07:35.409137 run osmo-msc_10.42.42.6(pid=27016): stderr: | 20221210100734516 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100734517 DLGLOBAL DEBUG validating counter group 0x7f7efb89ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100734517 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100734517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100734517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100734517 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100734522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100734522 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100734523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100734523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:35.458721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27009): Terminating (SIGTERM) 10:07:35.498002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27012): Terminating (SIGTERM) 10:07:35.537556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27015): Terminating (SIGTERM) 10:07:35.577405 --- ParallelTerminationStrategy: PID 27009 died... 10:07:35.596227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27009): Terminated: ok {rc=0} 10:07:35.639716 --- ParallelTerminationStrategy: PID 27012 died... 10:07:35.658137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27012): Terminated: ok {rc=0} 10:07:35.702618 --- ParallelTerminationStrategy: PID 27015 died... 10:07:35.721202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27015): Terminated: ok {rc=0} 10:07:35.807134 bus /sierra_3: Setting Powered False 10:07:36.909927 bus /sierra_3: Setting Powered False 10:07:38.026323 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:07:39.169294 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:39.180894 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:07:39.250789 tst mo_mt_call_osmux.py: using LAC 27650 10:07:39.370323 tst mo_mt_call_osmux.py: using RAC 110 10:07:39.499803 tst mo_mt_call_osmux.py: using CellId 27650 10:07:39.628569 tst mo_mt_call_osmux.py: using BVCI 27651 10:07:39.746698 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:39.758494 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:39.770134 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:39.782556 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:39.795613 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:07:39.807083 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:07:39.924862 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:07:40.045785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:40.546768 run create_hlr_db(pid=27019): Launched 10:07:40.670765 bus /sierra_2: Setting Powered False 10:07:41.734579 run create_hlr_db(pid=27019): Terminated: ok {rc=0} 10:07:42.166373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27021): Launched 10:07:42.470149 run osmo-hlr_10.42.42.2(pid=27022): Launched 10:07:42.586411 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:43.123923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27024): Launched 10:07:43.426397 run osmo-stp_10.42.42.5(pid=27025): Launched 10:07:43.541824 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:44.118625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27027): Launched 10:07:44.441788 run osmo-msc_10.42.42.6(pid=27028): Launched 10:07:44.621673 run osmo-stp_10.42.42.5(pid=27025): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27025)] 10:07:44.757348 run osmo-stp_10.42.42.5(pid=27025): stdout: | (launched: 2022-12-10_10:07:43.371288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:44.893331 run osmo-stp_10.42.42.5(pid=27025): stderr: | 20221210100743540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100743541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100743541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100743541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100743543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100743544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100743544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:45.029206 run osmo-stp_10.42.42.5(pid=27025): stdout: | (launched: 2022-12-10_10:07:43.371288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:45.157873 run osmo-stp_10.42.42.5(pid=27025): stderr: | 20221210100743540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100743541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100743541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100743541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100743543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100743544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100743544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:45.311573 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27025): Process ended prematurely: osmo-stp_10.42.42.5(pid=27025) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27025)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:07:45.321078 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:07:45.350344 run osmo-hlr_10.42.42.2(pid=27022): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27022)] 10:07:45.401055 run osmo-hlr_10.42.42.2(pid=27022): stdout: | (launched: 2022-12-10_10:07:42.415031) 10:07:45.453498 run osmo-hlr_10.42.42.2(pid=27022): stderr: | 20221210100742590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100742590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100742590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100742590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100742590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100742591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100742603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100742613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100742613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100742613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:45.526152 run osmo-msc_10.42.42.6(pid=27028): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27028)] 10:07:45.576699 run osmo-msc_10.42.42.6(pid=27028): stdout: | (launched: 2022-12-10_10:07:44.383936) 10:07:45.629232 run osmo-msc_10.42.42.6(pid=27028): stderr: | 20221210100744705 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100744705 DLGLOBAL DEBUG validating counter group 0x7fbb738c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100744705 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100744705 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100744705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100744706 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100744707 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100744708 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100744708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100744708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:45.682214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27021): Terminating (SIGTERM) 10:07:45.724602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27024): Terminating (SIGTERM) 10:07:45.767052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27027): Terminating (SIGTERM) 10:07:45.809682 --- ParallelTerminationStrategy: PID 27021 died... 10:07:45.830192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27021): Terminated: ok {rc=0} 10:07:45.900203 --- ParallelTerminationStrategy: PID 27024 died... 10:07:45.920464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27024): Terminated: ok {rc=0} 10:07:45.969530 --- ParallelTerminationStrategy: PID 27027 died... 10:07:45.989719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27027): Terminated: ok {rc=0} 10:07:46.081583 bus /sierra_3: Setting Powered False 10:07:47.181048 bus /sierra_3: Setting Powered False 10:07:48.300302 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:07:49.555359 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:07:49.563966 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:07:49.599752 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:07:49.627844 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:07:49.679467 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:07:49.713630 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:07:49.741119 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:07:50.295528 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:07:50.347613 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:07:50.359254 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:07:50.428573 tst mo_mt_call.py: using LAC 27651 10:07:50.552724 tst mo_mt_call.py: using RAC 111 10:07:50.676494 tst mo_mt_call.py: using CellId 27651 10:07:50.806197 tst mo_mt_call.py: using BVCI 27652 10:07:50.924152 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:07:50.935694 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:07:50.947057 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:07:50.958728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:07:50.970463 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:07:50.982178 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:07:51.098879 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:07:51.216453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:07:51.682197 run create_hlr_db(pid=27033): Launched 10:07:51.806103 bus /sierra_2: Setting Powered False 10:07:52.866379 run create_hlr_db(pid=27033): Terminated: ok {rc=0} 10:07:53.305434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27035): Launched 10:07:53.630808 run osmo-hlr_10.42.42.2(pid=27036): Launched 10:07:53.755189 run osmo-stp_10.42.42.5: Starting osmo-stp 10:07:54.314359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27038): Launched 10:07:54.635607 run osmo-stp_10.42.42.5(pid=27039): Launched 10:07:54.758865 run osmo-msc_10.42.42.6: Starting osmo-msc 10:07:55.345757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27041): Launched 10:07:55.669594 run osmo-msc_10.42.42.6(pid=27042): Launched 10:07:55.850183 run osmo-stp_10.42.42.5(pid=27039): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27039)] 10:07:55.986924 run osmo-stp_10.42.42.5(pid=27039): stdout: | (launched: 2022-12-10_10:07:54.577555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:56.124464 run osmo-stp_10.42.42.5(pid=27039): stderr: | 20221210100754770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100754770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100754770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100754770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100754771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100754771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100754771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:56.261234 run osmo-stp_10.42.42.5(pid=27039): stdout: | (launched: 2022-12-10_10:07:54.577555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:07:56.390446 run osmo-stp_10.42.42.5(pid=27039): stderr: | 20221210100754770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100754770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100754770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100754770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100754771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100754771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100754771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:07:56.544688 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27039): Process ended prematurely: osmo-stp_10.42.42.5(pid=27039) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27039)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:07:56.554240 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:07:56.582420 run osmo-hlr_10.42.42.2(pid=27036): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27036)] 10:07:56.632833 run osmo-hlr_10.42.42.2(pid=27036): stdout: | (launched: 2022-12-10_10:07:53.572004) 10:07:56.684822 run osmo-hlr_10.42.42.2(pid=27036): stderr: | 20221210100753769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100753769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100753769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100753769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100753769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100753769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100753781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100753790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100753790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100753790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:07:56.756639 run osmo-msc_10.42.42.6(pid=27042): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27042)] 10:07:56.806782 run osmo-msc_10.42.42.6(pid=27042): stdout: | (launched: 2022-12-10_10:07:55.610938) 10:07:56.859011 run osmo-msc_10.42.42.6(pid=27042): stderr: | 20221210100755932 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100755932 DLGLOBAL DEBUG validating counter group 0x7fa629e7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100755932 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100755932 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100755932 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100755932 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100755934 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100755934 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100755935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100755935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:07:56.911264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27035): Terminating (SIGTERM) 10:07:56.953172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27038): Terminating (SIGTERM) 10:07:56.995032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27041): Terminating (SIGTERM) 10:07:57.037170 --- ParallelTerminationStrategy: PID 27035 died... 10:07:57.056876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27035): Terminated: ok {rc=0} 10:07:57.103312 --- ParallelTerminationStrategy: PID 27038 died... 10:07:57.122706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27038): Terminated: ok {rc=0} 10:07:57.169437 --- ParallelTerminationStrategy: PID 27041 died... 10:07:57.189021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27041): Terminated: ok {rc=0} 10:07:57.277219 bus /sierra_3: Setting Powered False 10:07:58.377595 bus /sierra_3: Setting Powered False 10:07:59.492571 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:08:00.642113 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:00.654269 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:08:00.725749 tst mo_mt_call_osmux.py: using LAC 27652 10:08:00.870102 tst mo_mt_call_osmux.py: using RAC 112 10:08:01.002912 tst mo_mt_call_osmux.py: using CellId 27652 10:08:01.127807 tst mo_mt_call_osmux.py: using BVCI 27653 10:08:01.256351 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:01.269635 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:01.281580 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:01.293817 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:01.305924 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:08:01.318154 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:08:01.437259 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:08:01.566605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:02.127848 run create_hlr_db(pid=27044): Launched 10:08:02.285431 bus /sierra_2: Setting Powered False 10:08:03.348744 run create_hlr_db(pid=27044): Terminated: ok {rc=0} 10:08:03.781054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27046): Launched 10:08:04.082273 run osmo-hlr_10.42.42.2(pid=27047): Launched 10:08:04.198608 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:04.717442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27049): Launched 10:08:05.019869 run osmo-stp_10.42.42.5(pid=27050): Launched 10:08:05.134527 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:05.677848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27052): Launched 10:08:05.978643 run osmo-msc_10.42.42.6(pid=27053): Launched 10:08:06.146334 run osmo-stp_10.42.42.5(pid=27050): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27050)] 10:08:06.273262 run osmo-stp_10.42.42.5(pid=27050): stdout: | (launched: 2022-12-10_10:08:04.965248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:06.401070 run osmo-stp_10.42.42.5(pid=27050): stderr: | 20221210100805134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100805135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100805135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100805135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100805136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100805136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100805136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:06.526537 run osmo-stp_10.42.42.5(pid=27050): stdout: | (launched: 2022-12-10_10:08:04.965248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:06.646488 run osmo-stp_10.42.42.5(pid=27050): stderr: | 20221210100805134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100805135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100805135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100805135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100805136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100805136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100805136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:06.790210 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27050): Process ended prematurely: osmo-stp_10.42.42.5(pid=27050) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27050)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:08:06.799075 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:08:06.825404 run osmo-hlr_10.42.42.2(pid=27047): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27047)] 10:08:06.872855 run osmo-hlr_10.42.42.2(pid=27047): stdout: | (launched: 2022-12-10_10:08:04.027688) 10:08:06.921950 run osmo-hlr_10.42.42.2(pid=27047): stderr: | 20221210100804204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100804204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100804204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100804204 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100804204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100804204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100804216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100804225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100804225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100804225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:06.990306 run osmo-msc_10.42.42.6(pid=27053): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27053)] 10:08:07.037608 run osmo-msc_10.42.42.6(pid=27053): stdout: | (launched: 2022-12-10_10:08:05.923885) 10:08:07.086438 run osmo-msc_10.42.42.6(pid=27053): stderr: | 20221210100806194 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100806194 DLGLOBAL DEBUG validating counter group 0x7f2017d70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100806194 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100806194 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100806194 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100806194 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100806197 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100806198 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100806198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100806198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:07.135702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27046): Terminating (SIGTERM) 10:08:07.174969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27049): Terminating (SIGTERM) 10:08:07.214390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27052): Terminating (SIGTERM) 10:08:07.254260 --- ParallelTerminationStrategy: PID 27046 died... 10:08:07.273369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27046): Terminated: ok {rc=0} 10:08:07.317924 --- ParallelTerminationStrategy: PID 27049 died... 10:08:07.336465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27049): Terminated: ok {rc=0} 10:08:07.380397 --- ParallelTerminationStrategy: PID 27052 died... 10:08:07.399034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27052): Terminated: ok {rc=0} 10:08:07.482844 bus /sierra_3: Setting Powered False 10:08:08.581166 bus /sierra_3: Setting Powered False 10:08:09.696195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:08:10.962195 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:10.970495 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:08:11.005244 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:08:11.032725 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:08:11.092425 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:08:11.127585 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:08:11.155057 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:08:11.700085 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:08:11.751838 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:11.763356 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:08:11.834454 tst mo_mt_call.py: using LAC 27653 10:08:11.961378 tst mo_mt_call.py: using RAC 113 10:08:12.087396 tst mo_mt_call.py: using CellId 27653 10:08:12.214783 tst mo_mt_call.py: using BVCI 27654 10:08:12.331864 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:12.343338 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:12.355119 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:12.367122 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:12.378992 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:12.390659 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:08:12.505851 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:08:12.620541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:13.087802 run create_hlr_db(pid=27058): Launched 10:08:13.212017 bus /sierra_2: Setting Powered False 10:08:14.271704 run create_hlr_db(pid=27058): Terminated: ok {rc=0} 10:08:14.712933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27060): Launched 10:08:15.035132 run osmo-hlr_10.42.42.2(pid=27061): Launched 10:08:15.158971 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:15.719604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27063): Launched 10:08:16.055259 run osmo-stp_10.42.42.5(pid=27064): Launched 10:08:16.292057 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:17.010819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27102): Launched 10:08:17.402290 run osmo-msc_10.42.42.6(pid=27110): Launched 10:08:17.765519 run osmo-stp_10.42.42.5(pid=27064): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27064)] 10:08:18.080760 run osmo-stp_10.42.42.5(pid=27064): stdout: | (launched: 2022-12-10_10:08:15.992472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:18.261348 run osmo-stp_10.42.42.5(pid=27064): stderr: | 20221210100816178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100816178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100816178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100816179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100816179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100816179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100816179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:18.411448 run osmo-stp_10.42.42.5(pid=27064): stdout: | (launched: 2022-12-10_10:08:15.992472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:18.558652 run osmo-stp_10.42.42.5(pid=27064): stderr: | 20221210100816178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100816178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100816178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100816179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100816179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100816179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100816179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:18.753461 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27064): Process ended prematurely: osmo-stp_10.42.42.5(pid=27064) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27064)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:08:18.763854 tst mo_mt_call.py:8: Test FAILED (7.1 sec) 10:08:18.796161 run osmo-hlr_10.42.42.2(pid=27061): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27061)] 10:08:18.866815 run osmo-hlr_10.42.42.2(pid=27061): stdout: | (launched: 2022-12-10_10:08:14.977396) 10:08:18.932837 run osmo-hlr_10.42.42.2(pid=27061): stderr: | 20221210100815176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100815176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100815176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100815177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100815177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100815177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100815190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100815198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100815199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100815199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:19.028375 run osmo-msc_10.42.42.6(pid=27110): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27110)] 10:08:19.095919 run osmo-msc_10.42.42.6(pid=27110): stdout: | (launched: 2022-12-10_10:08:17.320880) 10:08:19.158568 run osmo-msc_10.42.42.6(pid=27110): stderr: | 20221210100817832 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100817848 DLGLOBAL DEBUG validating counter group 0x7f085083fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100817848 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100817848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100817849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100817849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100817851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100817851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100817851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100817851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:19.227623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27060): Terminating (SIGTERM) 10:08:19.283654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27063): Terminating (SIGTERM) 10:08:19.337617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27102): Terminating (SIGTERM) 10:08:19.391475 --- ParallelTerminationStrategy: PID 27060 died... 10:08:19.414538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27060): Terminated: ok {rc=0} 10:08:19.471121 --- ParallelTerminationStrategy: PID 27063 died... 10:08:19.496838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27063): Terminated: ok {rc=0} 10:08:19.556707 --- ParallelTerminationStrategy: PID 27102 died... 10:08:19.583962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27102): Terminated: ok {rc=0} 10:08:19.700705 bus /sierra_3: Setting Powered False 10:08:20.822670 bus /sierra_3: Setting Powered False 10:08:21.944565 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:08:23.095545 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:23.108319 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:08:23.179427 tst mo_mt_call_osmux.py: using LAC 27654 10:08:23.302880 tst mo_mt_call_osmux.py: using RAC 114 10:08:23.422524 tst mo_mt_call_osmux.py: using CellId 27654 10:08:23.544637 tst mo_mt_call_osmux.py: using BVCI 27655 10:08:23.656838 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:23.669829 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:23.681165 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:23.692549 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:23.704391 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:08:23.716108 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:08:23.833030 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:08:23.953059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:24.440545 run create_hlr_db(pid=27341): Launched 10:08:24.593333 bus /sierra_2: Setting Powered False 10:08:25.654776 run create_hlr_db(pid=27341): Terminated: ok {rc=0} 10:08:26.105802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27343): Launched 10:08:26.430924 run osmo-hlr_10.42.42.2(pid=27344): Launched 10:08:26.681593 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:27.342194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27346): Launched 10:08:27.669009 run osmo-stp_10.42.42.5(pid=27347): Launched 10:08:27.916377 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:28.605746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27349): Launched 10:08:28.948098 run osmo-msc_10.42.42.6(pid=27350): Launched 10:08:29.314090 run osmo-stp_10.42.42.5(pid=27347): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27347)] 10:08:29.603001 run osmo-stp_10.42.42.5(pid=27347): stdout: | (launched: 2022-12-10_10:08:27.604242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:29.773310 run osmo-stp_10.42.42.5(pid=27347): stderr: | 20221210100827901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100827901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100827902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100827902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100827903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100827903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100827903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:29.914333 run osmo-stp_10.42.42.5(pid=27347): stdout: | (launched: 2022-12-10_10:08:27.604242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:30.047975 run osmo-stp_10.42.42.5(pid=27347): stderr: | 20221210100827901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100827901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100827902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100827902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100827903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100827903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100827903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:30.208009 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27347): Process ended prematurely: osmo-stp_10.42.42.5(pid=27347) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27347)] [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:08:30.219067 tst mo_mt_call_osmux.py:8: Test FAILED (7.2 sec) 10:08:30.251227 run osmo-hlr_10.42.42.2(pid=27344): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27344)] 10:08:30.305132 run osmo-hlr_10.42.42.2(pid=27344): stdout: | (launched: 2022-12-10_10:08:26.368336) 10:08:30.361175 run osmo-hlr_10.42.42.2(pid=27344): stderr: | 20221210100826717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100826717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100826717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100826717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100826717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100826717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100826735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100826752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100826752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100826752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:30.438071 run osmo-msc_10.42.42.6(pid=27350): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27350)] 10:08:30.491847 run osmo-msc_10.42.42.6(pid=27350): stdout: | (launched: 2022-12-10_10:08:28.884667) 10:08:30.547220 run osmo-msc_10.42.42.6(pid=27350): stderr: | 20221210100829392 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100829392 DLGLOBAL DEBUG validating counter group 0x7fb229bc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100829392 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100829392 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100829392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100829392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100829394 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100829395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100829395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100829395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:30.603985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27343): Terminating (SIGTERM) 10:08:30.649651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27346): Terminating (SIGTERM) 10:08:30.696362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27349): Terminating (SIGTERM) 10:08:30.742404 --- ParallelTerminationStrategy: PID 27343 died... 10:08:30.763598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27343): Terminated: ok {rc=0} 10:08:30.815799 --- ParallelTerminationStrategy: PID 27346 died... 10:08:30.837432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27346): Terminated: ok {rc=0} 10:08:30.887670 --- ParallelTerminationStrategy: PID 27349 died... 10:08:30.908779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27349): Terminated: ok {rc=0} 10:08:31.010180 bus /sierra_3: Setting Powered False 10:08:32.147703 bus /sierra_3: Setting Powered False 10:08:33.292311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:08:34.549121 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:34.556284 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:08:34.592157 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:08:34.620935 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:08:34.673285 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:08:34.707958 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:08:34.735851 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:08:35.293665 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:08:35.346784 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:35.358950 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:08:35.430889 tst mo_mt_call.py: using LAC 27655 10:08:35.554868 tst mo_mt_call.py: using RAC 115 10:08:35.678867 tst mo_mt_call.py: using CellId 27655 10:08:35.802408 tst mo_mt_call.py: using BVCI 27656 10:08:35.916916 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:35.929562 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:35.941654 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:35.953839 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:35.966116 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:35.979102 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:08:36.099913 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:08:36.221141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:36.717230 run create_hlr_db(pid=27355): Launched 10:08:36.870387 bus /sierra_2: Setting Powered False 10:08:37.932106 run create_hlr_db(pid=27355): Terminated: ok {rc=0} 10:08:38.377754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27357): Launched 10:08:38.725478 run osmo-hlr_10.42.42.2(pid=27358): Launched 10:08:38.967990 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:39.705409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27360): Launched 10:08:40.027879 run osmo-stp_10.42.42.5(pid=27361): Launched 10:08:40.151390 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:40.735894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27363): Launched 10:08:41.058966 run osmo-msc_10.42.42.6(pid=27364): Launched 10:08:41.239409 run osmo-stp_10.42.42.5(pid=27361): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27361)] 10:08:41.375613 run osmo-stp_10.42.42.5(pid=27361): stdout: | (launched: 2022-12-10_10:08:39.970080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:41.512660 run osmo-stp_10.42.42.5(pid=27361): stderr: | 20221210100840163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100840163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100840164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100840164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100840165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100840165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100840165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:41.649390 run osmo-stp_10.42.42.5(pid=27361): stdout: | (launched: 2022-12-10_10:08:39.970080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:41.777950 run osmo-stp_10.42.42.5(pid=27361): stderr: | 20221210100840163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100840163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100840164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100840164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100840165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100840165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100840165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:41.931917 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27361): Process ended prematurely: osmo-stp_10.42.42.5(pid=27361) [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27361)] [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:08:41.941571 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:08:41.970105 run osmo-hlr_10.42.42.2(pid=27358): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27358)] 10:08:42.020644 run osmo-hlr_10.42.42.2(pid=27358): stdout: | (launched: 2022-12-10_10:08:38.649093) 10:08:42.072633 run osmo-hlr_10.42.42.2(pid=27358): stderr: | 20221210100839006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100839006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100839006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100839006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100839006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100839006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100839018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100839030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100839031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100839031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:42.144816 run osmo-msc_10.42.42.6(pid=27364): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27364)] 10:08:42.195038 run osmo-msc_10.42.42.6(pid=27364): stdout: | (launched: 2022-12-10_10:08:41.000752) 10:08:42.246777 run osmo-msc_10.42.42.6(pid=27364): stderr: | 20221210100841323 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100841324 DLGLOBAL DEBUG validating counter group 0x7f20f18bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100841324 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100841324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100841324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100841324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100841326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100841326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100841326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100841327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:42.299507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27357): Terminating (SIGTERM) 10:08:42.341610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27360): Terminating (SIGTERM) 10:08:42.383686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27363): Terminating (SIGTERM) 10:08:42.426017 --- ParallelTerminationStrategy: PID 27357 died... 10:08:42.446011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27357): Terminated: ok {rc=0} 10:08:42.492735 --- ParallelTerminationStrategy: PID 27360 died... 10:08:42.512535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27360): Terminated: ok {rc=0} 10:08:42.559732 --- ParallelTerminationStrategy: PID 27363 died... 10:08:42.579473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27363): Terminated: ok {rc=0} 10:08:42.670327 bus /sierra_3: Setting Powered False 10:08:43.768701 bus /sierra_3: Setting Powered False 10:08:44.884096 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:08:46.054073 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:46.070953 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:08:46.154161 tst mo_mt_call_osmux.py: using LAC 27656 10:08:46.321902 tst mo_mt_call_osmux.py: using RAC 116 10:08:46.445185 tst mo_mt_call_osmux.py: using CellId 27656 10:08:46.568621 tst mo_mt_call_osmux.py: using BVCI 27657 10:08:46.687864 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:46.700755 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:46.712346 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:46.723948 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:46.736150 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:08:46.748233 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:08:46.885324 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:08:47.029827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:47.558851 run create_hlr_db(pid=27366): Launched 10:08:47.683172 bus /sierra_2: Setting Powered False 10:08:48.747139 run create_hlr_db(pid=27366): Terminated: ok {rc=0} 10:08:49.178622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27368): Launched 10:08:49.481800 run osmo-hlr_10.42.42.2(pid=27369): Launched 10:08:49.597634 run osmo-stp_10.42.42.5: Starting osmo-stp 10:08:50.133455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27371): Launched 10:08:50.437572 run osmo-stp_10.42.42.5(pid=27372): Launched 10:08:50.553402 run osmo-msc_10.42.42.6: Starting osmo-msc 10:08:51.101714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27374): Launched 10:08:51.404212 run osmo-msc_10.42.42.6(pid=27375): Launched 10:08:51.573584 run osmo-stp_10.42.42.5(pid=27372): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27372)] 10:08:51.701344 run osmo-stp_10.42.42.5(pid=27372): stdout: | (launched: 2022-12-10_10:08:50.382858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:51.828814 run osmo-stp_10.42.42.5(pid=27372): stderr: | 20221210100850556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100850556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100850556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100850557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100850557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100850558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100850558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:51.954978 run osmo-stp_10.42.42.5(pid=27372): stdout: | (launched: 2022-12-10_10:08:50.382858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:08:52.074727 run osmo-stp_10.42.42.5(pid=27372): stderr: | 20221210100850556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100850556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100850556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100850557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100850557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100850558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100850558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:08:52.218760 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27372): Process ended prematurely: osmo-stp_10.42.42.5(pid=27372) [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27372)] [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:08:52.227577 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:08:52.253955 run osmo-hlr_10.42.42.2(pid=27369): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27369)] 10:08:52.301491 run osmo-hlr_10.42.42.2(pid=27369): stdout: | (launched: 2022-12-10_10:08:49.426635) 10:08:52.350491 run osmo-hlr_10.42.42.2(pid=27369): stderr: | 20221210100849605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100849605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100849605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100849605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100849605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100849605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100849617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100849627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100849627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100849627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:08:52.419197 run osmo-msc_10.42.42.6(pid=27375): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27375)] 10:08:52.466550 run osmo-msc_10.42.42.6(pid=27375): stdout: | (launched: 2022-12-10_10:08:51.349188) 10:08:52.515473 run osmo-msc_10.42.42.6(pid=27375): stderr: | 20221210100851623 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100851623 DLGLOBAL DEBUG validating counter group 0x7f745eb27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100851623 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100851623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100851623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100851623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100851626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100851627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100851627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100851627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:08:52.564682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27368): Terminating (SIGTERM) 10:08:52.604032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27371): Terminating (SIGTERM) 10:08:52.643375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27374): Terminating (SIGTERM) 10:08:52.682955 --- ParallelTerminationStrategy: PID 27368 died... 10:08:52.702003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27368): Terminated: ok {rc=0} 10:08:52.746091 --- ParallelTerminationStrategy: PID 27371 died... 10:08:52.764487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27371): Terminated: ok {rc=0} 10:08:52.808009 --- ParallelTerminationStrategy: PID 27374 died... 10:08:52.826620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27374): Terminated: ok {rc=0} 10:08:52.912398 bus /sierra_3: Setting Powered False 10:08:54.012137 bus /sierra_3: Setting Powered False 10:08:55.126652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:08:56.377460 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:08:56.383235 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:08:56.416073 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:08:56.442814 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:08:56.495229 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:08:56.528467 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:08:56.555082 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:08:57.102946 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:08:57.151016 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:08:57.161953 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:08:57.232605 tst mo_mt_call.py: using LAC 27657 10:08:57.351992 tst mo_mt_call.py: using RAC 117 10:08:57.471809 tst mo_mt_call.py: using CellId 27657 10:08:57.592290 tst mo_mt_call.py: using BVCI 27658 10:08:57.702825 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:08:57.713943 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:08:57.724540 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:08:57.735211 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:08:57.746002 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:08:57.756682 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:08:57.874969 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:08:57.989648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:08:58.456322 run create_hlr_db(pid=27380): Launched 10:08:58.580593 bus /sierra_2: Setting Powered False 10:08:59.641418 run create_hlr_db(pid=27380): Terminated: ok {rc=0} 10:09:00.062488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27382): Launched 10:09:00.364787 run osmo-hlr_10.42.42.2(pid=27383): Launched 10:09:00.480061 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:01.045008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27385): Launched 10:09:01.457172 run osmo-stp_10.42.42.5(pid=27386): Launched 10:09:01.632937 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:02.477714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27388): Launched 10:09:02.809090 run osmo-msc_10.42.42.6(pid=27389): Launched 10:09:02.989262 run osmo-stp_10.42.42.5(pid=27386): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27386)] 10:09:03.124573 run osmo-stp_10.42.42.5(pid=27386): stdout: | (launched: 2022-12-10_10:09:01.385065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:03.261176 run osmo-stp_10.42.42.5(pid=27386): stderr: | 20221210100901746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100901746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100901747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100901747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100901747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100901747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100901748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:03.397650 run osmo-stp_10.42.42.5(pid=27386): stdout: | (launched: 2022-12-10_10:09:01.385065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:03.526450 run osmo-stp_10.42.42.5(pid=27386): stderr: | 20221210100901746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100901746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100901747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100901747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100901747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100901747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100901748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:03.681377 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27386): Process ended prematurely: osmo-stp_10.42.42.5(pid=27386) [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27386)] [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:09:03.690851 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:09:03.719521 run osmo-hlr_10.42.42.2(pid=27383): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27383)] 10:09:03.770293 run osmo-hlr_10.42.42.2(pid=27383): stdout: | (launched: 2022-12-10_10:09:00.309991) 10:09:03.822745 run osmo-hlr_10.42.42.2(pid=27383): stderr: | 20221210100900485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100900485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100900485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100900485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100900485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100900485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100900496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100900506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100900506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100900506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:03.895739 run osmo-msc_10.42.42.6(pid=27389): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27389)] 10:09:03.946553 run osmo-msc_10.42.42.6(pid=27389): stdout: | (launched: 2022-12-10_10:09:02.750300) 10:09:03.998940 run osmo-msc_10.42.42.6(pid=27389): stderr: | 20221210100903074 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100903074 DLGLOBAL DEBUG validating counter group 0x7f849304dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100903074 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100903074 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100903074 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100903074 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100903076 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100903077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100903077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100903077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:04.051898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27382): Terminating (SIGTERM) 10:09:04.094341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27385): Terminating (SIGTERM) 10:09:04.136811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27388): Terminating (SIGTERM) 10:09:04.179399 --- ParallelTerminationStrategy: PID 27382 died... 10:09:04.199520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27382): Terminated: ok {rc=0} 10:09:04.247142 --- ParallelTerminationStrategy: PID 27385 died... 10:09:04.266837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27385): Terminated: ok {rc=0} 10:09:04.314061 --- ParallelTerminationStrategy: PID 27388 died... 10:09:04.333805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27388): Terminated: ok {rc=0} 10:09:04.422802 bus /sierra_3: Setting Powered False 10:09:05.522795 bus /sierra_3: Setting Powered False 10:09:06.638641 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:09:07.789566 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:09:07.801645 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:09:07.875426 tst mo_mt_call_osmux.py: using LAC 27658 10:09:08.002111 tst mo_mt_call_osmux.py: using RAC 118 10:09:08.127828 tst mo_mt_call_osmux.py: using CellId 27658 10:09:08.256513 tst mo_mt_call_osmux.py: using BVCI 27659 10:09:08.373936 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:09:08.385481 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:09:08.396577 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:09:08.408023 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:09:08.419448 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:09:08.430958 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:09:08.547247 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:09:08.662576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:09.131663 run create_hlr_db(pid=27391): Launched 10:09:09.256497 bus /sierra_2: Setting Powered False 10:09:10.317495 run create_hlr_db(pid=27391): Terminated: ok {rc=0} 10:09:10.759732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27393): Launched 10:09:11.083168 run osmo-hlr_10.42.42.2(pid=27394): Launched 10:09:11.206691 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:11.767976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27396): Launched 10:09:12.091306 run osmo-stp_10.42.42.5(pid=27397): Launched 10:09:12.215200 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:12.801781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27399): Launched 10:09:13.125304 run osmo-msc_10.42.42.6(pid=27400): Launched 10:09:13.306088 run osmo-stp_10.42.42.5(pid=27397): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27397)] 10:09:13.443293 run osmo-stp_10.42.42.5(pid=27397): stdout: | (launched: 2022-12-10_10:09:12.033069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:13.581672 run osmo-stp_10.42.42.5(pid=27397): stderr: | 20221210100912224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100912224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100912224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100912225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100912225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100912225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100912225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:13.719064 run osmo-stp_10.42.42.5(pid=27397): stdout: | (launched: 2022-12-10_10:09:12.033069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:13.847770 run osmo-stp_10.42.42.5(pid=27397): stderr: | 20221210100912224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100912224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100912224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100912225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100912225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100912225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100912225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:14.002006 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27397): Process ended prematurely: osmo-stp_10.42.42.5(pid=27397) [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27397)] [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:09:14.011490 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:09:14.040197 run osmo-hlr_10.42.42.2(pid=27394): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27394)] 10:09:14.091014 run osmo-hlr_10.42.42.2(pid=27394): stdout: | (launched: 2022-12-10_10:09:11.025109) 10:09:14.144142 run osmo-hlr_10.42.42.2(pid=27394): stderr: | 20221210100911223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100911223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100911223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100911223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100911223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100911223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100911234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100911242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100911242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100911243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:14.217797 run osmo-msc_10.42.42.6(pid=27400): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27400)] 10:09:14.269124 run osmo-msc_10.42.42.6(pid=27400): stdout: | (launched: 2022-12-10_10:09:13.066787) 10:09:14.321798 run osmo-msc_10.42.42.6(pid=27400): stderr: | 20221210100913390 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100913390 DLGLOBAL DEBUG validating counter group 0x7f11f3cf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100913390 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100913390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100913390 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100913390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100913392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100913392 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100913393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100913393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:14.375138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27393): Terminating (SIGTERM) 10:09:14.417909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27396): Terminating (SIGTERM) 10:09:14.460715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27399): Terminating (SIGTERM) 10:09:14.503368 --- ParallelTerminationStrategy: PID 27393 died... 10:09:14.523531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27393): Terminated: ok {rc=0} 10:09:14.570436 --- ParallelTerminationStrategy: PID 27396 died... 10:09:14.590004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27396): Terminated: ok {rc=0} 10:09:14.636640 --- ParallelTerminationStrategy: PID 27399 died... 10:09:14.656360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27399): Terminated: ok {rc=0} 10:09:14.745202 bus /sierra_3: Setting Powered False 10:09:15.852051 bus /sierra_3: Setting Powered False 10:09:16.978005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 10:09:18.227233 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:18.232091 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 10:09:18.265386 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 10:09:18.291932 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 10:09:18.343054 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 10:09:18.375880 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 10:09:18.402214 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 10:09:18.952381 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 10:09:19.000707 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:19.011945 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:09:19.065494 tst mo_mt_call.py: using LAC 27659 10:09:19.182874 tst mo_mt_call.py: using RAC 119 10:09:19.299923 tst mo_mt_call.py: using CellId 27659 10:09:19.417224 tst mo_mt_call.py: using BVCI 27660 10:09:19.526343 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:19.537338 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:19.548048 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:19.558855 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:19.569646 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:19.580388 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:09:19.698645 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:09:19.819662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:20.321419 run create_hlr_db(pid=27405): Launched 10:09:20.446190 bus /sierra_2: Setting Powered False 10:09:21.509985 run create_hlr_db(pid=27405): Terminated: ok {rc=0} 10:09:21.959815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27408): Launched 10:09:22.282300 run osmo-hlr_10.42.42.2(pid=27409): Launched 10:09:22.406024 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:22.936607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27411): Launched 10:09:23.239899 run osmo-stp_10.42.42.5(pid=27412): Launched 10:09:23.356017 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:23.901259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27414): Launched 10:09:24.202712 run osmo-msc_10.42.42.6(pid=27415): Launched 10:09:24.372821 run osmo-stp_10.42.42.5(pid=27412): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27412)] 10:09:24.500738 run osmo-stp_10.42.42.5(pid=27412): stdout: | (launched: 2022-12-10_10:09:23.185163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:24.628716 run osmo-stp_10.42.42.5(pid=27412): stderr: | 20221210100923355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100923355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100923355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100923356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100923358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100923358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100923358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:24.755310 run osmo-stp_10.42.42.5(pid=27412): stdout: | (launched: 2022-12-10_10:09:23.185163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:24.875858 run osmo-stp_10.42.42.5(pid=27412): stderr: | 20221210100923355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100923355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100923355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100923356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100923358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100923358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100923358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:25.020720 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27412): Process ended prematurely: osmo-stp_10.42.42.5(pid=27412) [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27412)] [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 10:09:25.029670 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:09:25.056355 run osmo-hlr_10.42.42.2(pid=27409): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27409)] 10:09:25.105330 run osmo-hlr_10.42.42.2(pid=27409): stdout: | (launched: 2022-12-10_10:09:22.224329) 10:09:25.155124 run osmo-hlr_10.42.42.2(pid=27409): stderr: | 20221210100922422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100922422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100922422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100922422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100922422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100922422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100922435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100922443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100922444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100922444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:25.224295 run osmo-msc_10.42.42.6(pid=27415): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27415)] 10:09:25.271887 run osmo-msc_10.42.42.6(pid=27415): stdout: | (launched: 2022-12-10_10:09:24.148267) 10:09:25.321168 run osmo-msc_10.42.42.6(pid=27415): stderr: | 20221210100924420 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100924420 DLGLOBAL DEBUG validating counter group 0x7f4f3398ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100924420 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100924420 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100924420 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100924420 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100924423 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100924423 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100924423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100924423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:25.370709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27408): Terminating (SIGTERM) 10:09:25.410455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27411): Terminating (SIGTERM) 10:09:25.450307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27414): Terminating (SIGTERM) 10:09:25.490302 --- ParallelTerminationStrategy: PID 27408 died... 10:09:25.509481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27408): Terminated: ok {rc=0} 10:09:25.554047 --- ParallelTerminationStrategy: PID 27411 died... 10:09:25.572561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27411): Terminated: ok {rc=0} 10:09:25.616524 --- ParallelTerminationStrategy: PID 27414 died... 10:09:25.635132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27414): Terminated: ok {rc=0} 10:09:25.719070 bus /sierra_3: Setting Powered False 10:09:26.817867 bus /sierra_3: Setting Powered False 10:09:27.937055 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 10:09:29.083425 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:29.094790 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 10:09:29.145581 tst mo_mt_call_osmux.py: using LAC 27660 10:09:29.273618 tst mo_mt_call_osmux.py: using RAC 120 10:09:29.392718 tst mo_mt_call_osmux.py: using CellId 27660 10:09:29.510671 tst mo_mt_call_osmux.py: using BVCI 27661 10:09:29.619722 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:29.630696 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:29.641454 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:29.652087 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:29.673909 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 10:09:29.684649 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:09:29.804299 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 10:09:29.922229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:30.390484 run create_hlr_db(pid=27417): Launched 10:09:30.514749 bus /sierra_2: Setting Powered False 10:09:31.590072 run create_hlr_db(pid=27417): Terminated: ok {rc=0} 10:09:32.049757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Launched 10:09:32.383922 run osmo-hlr_10.42.42.2(pid=27420): Launched 10:09:32.509891 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:33.072487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Launched 10:09:33.395662 run osmo-stp_10.42.42.5(pid=27423): Launched 10:09:33.519062 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:34.103570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Launched 10:09:34.425458 run osmo-msc_10.42.42.6(pid=27426): Launched 10:09:34.606991 run osmo-stp_10.42.42.5(pid=27423): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] 10:09:34.744069 run osmo-stp_10.42.42.5(pid=27423): stdout: | (launched: 2022-12-10_10:09:33.337886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:34.881832 run osmo-stp_10.42.42.5(pid=27423): stderr: | 20221210100933530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100933530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100933531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100933531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100933531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100933532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100933532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:35.018676 run osmo-stp_10.42.42.5(pid=27423): stdout: | (launched: 2022-12-10_10:09:33.337886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:35.148486 run osmo-stp_10.42.42.5(pid=27423): stderr: | 20221210100933530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100933530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100933531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100933531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100933531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100933532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100933532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:35.303116 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27423): Process ended prematurely: osmo-stp_10.42.42.5(pid=27423) [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 10:09:35.312792 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:09:35.341029 run osmo-hlr_10.42.42.2(pid=27420): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27420)] 10:09:35.391513 run osmo-hlr_10.42.42.2(pid=27420): stdout: | (launched: 2022-12-10_10:09:32.325737) 10:09:35.443403 run osmo-hlr_10.42.42.2(pid=27420): stderr: | 20221210100932524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100932524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100932524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100932524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100932524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100932524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100932537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100932545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100932545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100932545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:35.515388 run osmo-msc_10.42.42.6(pid=27426): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27426)] 10:09:35.565664 run osmo-msc_10.42.42.6(pid=27426): stdout: | (launched: 2022-12-10_10:09:34.367583) 10:09:35.617418 run osmo-msc_10.42.42.6(pid=27426): stderr: | 20221210100934690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100934691 DLGLOBAL DEBUG validating counter group 0x7ff9b9513c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100934691 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100934691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100934691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100934691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100934693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100934693 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100934693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100934693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:35.669998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Terminating (SIGTERM) 10:09:35.711920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Terminating (SIGTERM) 10:09:35.754281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Terminating (SIGTERM) 10:09:35.796576 --- ParallelTerminationStrategy: PID 27419 died... 10:09:35.816553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Terminated: ok {rc=0} 10:09:35.863745 --- ParallelTerminationStrategy: PID 27422 died... 10:09:35.883458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Terminated: ok {rc=0} 10:09:35.930015 --- ParallelTerminationStrategy: PID 27425 died... 10:09:35.949449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Terminated: ok {rc=0} 10:09:36.038433 bus /sierra_3: Setting Powered False 10:09:37.137685 bus /sierra_3: Setting Powered False 10:09:38.252817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:09:39.505080 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:09:39.511676 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:09:39.547098 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:09:39.574738 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:09:39.627506 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:09:39.661760 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:09:39.689749 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:09:40.247187 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:09:40.299306 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:40.311086 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:09:40.363120 tst mo_mt_call.py: using LAC 27661 10:09:40.481800 tst mo_mt_call.py: using RAC 121 10:09:40.599774 tst mo_mt_call.py: using CellId 27661 10:09:40.717807 tst mo_mt_call.py: using BVCI 27662 10:09:40.828221 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:40.839648 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:40.850893 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:40.863233 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:40.874628 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:40.886300 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:09:41.006289 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:09:41.129142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:41.631384 run create_hlr_db(pid=27432): Launched 10:09:41.756209 bus /sierra_2: Setting Powered False 10:09:42.820377 run create_hlr_db(pid=27432): Terminated: ok {rc=0} 10:09:43.253733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27434): Launched 10:09:43.556383 run osmo-hlr_10.42.42.2(pid=27435): Launched 10:09:43.673104 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:44.205704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27437): Launched 10:09:44.508810 run osmo-stp_10.42.42.5(pid=27438): Launched 10:09:44.625584 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:45.174268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27440): Launched 10:09:45.498307 run osmo-msc_10.42.42.6(pid=27441): Launched 10:09:45.679814 run osmo-stp_10.42.42.5(pid=27438): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27438)] 10:09:45.816520 run osmo-stp_10.42.42.5(pid=27438): stdout: | (launched: 2022-12-10_10:09:44.453974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:45.994982 run osmo-stp_10.42.42.5(pid=27438): stderr: | 20221210100944626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100944626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100944626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100944627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100944627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100944627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100944627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:46.233286 run osmo-stp_10.42.42.5(pid=27438): stdout: | (launched: 2022-12-10_10:09:44.453974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:46.393731 run osmo-stp_10.42.42.5(pid=27438): stderr: | 20221210100944626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100944626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100944626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100944627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100944627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100944627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100944627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:46.581403 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27438): Process ended prematurely: osmo-stp_10.42.42.5(pid=27438) [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27438)] [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:09:46.592695 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:09:46.622583 run osmo-hlr_10.42.42.2(pid=27435): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27435)] 10:09:46.676220 run osmo-hlr_10.42.42.2(pid=27435): stdout: | (launched: 2022-12-10_10:09:43.501684) 10:09:46.731085 run osmo-hlr_10.42.42.2(pid=27435): stderr: | 20221210100943678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100943678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100943678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100943678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100943678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100943678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100943690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100943699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100943699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100943699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:46.807208 run osmo-msc_10.42.42.6(pid=27441): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27441)] 10:09:46.859916 run osmo-msc_10.42.42.6(pid=27441): stdout: | (launched: 2022-12-10_10:09:45.440349) 10:09:46.914353 run osmo-msc_10.42.42.6(pid=27441): stderr: | 20221210100945761 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100945762 DLGLOBAL DEBUG validating counter group 0x7f8f9e7cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100945762 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100945762 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100945762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100945762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100945764 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100945764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100945764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100945764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:46.969594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27434): Terminating (SIGTERM) 10:09:47.015324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27437): Terminating (SIGTERM) 10:09:47.061756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27440): Terminating (SIGTERM) 10:09:47.111398 --- ParallelTerminationStrategy: PID 27434 died... 10:09:47.135347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27434): Terminated: ok {rc=0} 10:09:47.191784 --- ParallelTerminationStrategy: PID 27437 died... 10:09:47.215207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27437): Terminated: ok {rc=0} 10:09:47.265602 --- ParallelTerminationStrategy: PID 27440 died... 10:09:47.284716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27440): Terminated: ok {rc=0} 10:09:47.369838 bus /sierra_3: Setting Powered False 10:09:48.467530 bus /sierra_3: Setting Powered False 10:09:49.585761 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:09:50.735766 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:50.748230 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:09:50.802225 tst mo_mt_call_osmux.py: using LAC 27662 10:09:50.929360 tst mo_mt_call_osmux.py: using RAC 122 10:09:51.056223 tst mo_mt_call_osmux.py: using CellId 27662 10:09:51.182498 tst mo_mt_call_osmux.py: using BVCI 27663 10:09:51.299867 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:51.311705 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:51.323395 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:51.335174 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:51.346945 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:09:51.359210 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:09:51.481218 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:09:51.605575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:09:52.106100 run create_hlr_db(pid=27443): Launched 10:09:52.230156 bus /sierra_2: Setting Powered False 10:09:53.293805 run create_hlr_db(pid=27443): Terminated: ok {rc=0} 10:09:53.743590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27445): Launched 10:09:54.065864 run osmo-hlr_10.42.42.2(pid=27446): Launched 10:09:54.190221 run osmo-stp_10.42.42.5: Starting osmo-stp 10:09:54.743105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27448): Launched 10:09:55.066162 run osmo-stp_10.42.42.5(pid=27449): Launched 10:09:55.190142 run osmo-msc_10.42.42.6: Starting osmo-msc 10:09:55.774081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27451): Launched 10:09:56.097085 run osmo-msc_10.42.42.6(pid=27452): Launched 10:09:56.278024 run osmo-stp_10.42.42.5(pid=27449): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27449)] 10:09:56.415493 run osmo-stp_10.42.42.5(pid=27449): stdout: | (launched: 2022-12-10_10:09:55.008200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:56.552895 run osmo-stp_10.42.42.5(pid=27449): stderr: | 20221210100955199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100955199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100955199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100955200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100955200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100955200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100955200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:56.689832 run osmo-stp_10.42.42.5(pid=27449): stdout: | (launched: 2022-12-10_10:09:55.008200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:09:56.818916 run osmo-stp_10.42.42.5(pid=27449): stderr: | 20221210100955199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210100955199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210100955199 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210100955200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210100955200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210100955200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210100955200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:09:56.972849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27449): Process ended prematurely: osmo-stp_10.42.42.5(pid=27449) [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27449)] [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:09:56.982353 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:09:57.010571 run osmo-hlr_10.42.42.2(pid=27446): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27446)] 10:09:57.060753 run osmo-hlr_10.42.42.2(pid=27446): stdout: | (launched: 2022-12-10_10:09:54.008117) 10:09:57.112749 run osmo-hlr_10.42.42.2(pid=27446): stderr: | 20221210100954204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210100954204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210100954204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210100954205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210100954205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210100954205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210100954219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210100954228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210100954228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210100954228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:09:57.185348 run osmo-msc_10.42.42.6(pid=27452): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27452)] 10:09:57.235573 run osmo-msc_10.42.42.6(pid=27452): stdout: | (launched: 2022-12-10_10:09:56.039062) 10:09:57.287439 run osmo-msc_10.42.42.6(pid=27452): stderr: | 20221210100956360 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210100956360 DLGLOBAL DEBUG validating counter group 0x7f033b486c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210100956360 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210100956360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210100956361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210100956361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210100956363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210100956363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210100956363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210100956363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:09:57.339620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27445): Terminating (SIGTERM) 10:09:57.381652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27448): Terminating (SIGTERM) 10:09:57.423728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27451): Terminating (SIGTERM) 10:09:57.465976 --- ParallelTerminationStrategy: PID 27445 died... 10:09:57.486073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27445): Terminated: ok {rc=0} 10:09:57.532578 --- ParallelTerminationStrategy: PID 27448 died... 10:09:57.552486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27448): Terminated: ok {rc=0} 10:09:57.599104 --- ParallelTerminationStrategy: PID 27451 died... 10:09:57.618606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27451): Terminated: ok {rc=0} 10:09:57.706353 bus /sierra_3: Setting Powered False 10:09:58.806023 bus /sierra_3: Setting Powered False 10:09:59.921084 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:trx-b200 --------------------------------------------------------------------- 10:10:01.195681 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:01.204236 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 10:10:01.243218 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 10:10:01.273081 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 10:10:01.361714 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 10:10:01.397576 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 10:10:01.427197 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 10:10:02.014394 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 10:10:02.021345 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:02.033703 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:10:02.088924 tst emergency_mo_mt_call.py: using LAC 27663 10:10:02.214513 tst emergency_mo_mt_call.py: using RAC 123 10:10:02.339269 tst emergency_mo_mt_call.py: using CellId 27663 10:10:02.462005 tst emergency_mo_mt_call.py: using BVCI 27664 10:10:02.577240 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:02.588390 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:02.599361 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:02.610519 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:02.621797 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:02.632794 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:10:02.747435 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:10:02.860484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:03.320707 run create_hlr_db(pid=27461): Launched 10:10:03.444646 bus /sierra_2: Setting Powered False 10:10:04.504353 run create_hlr_db(pid=27461): Terminated: ok {rc=0} 10:10:04.939803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27463): Launched 10:10:05.256526 run osmo-hlr_10.42.42.2(pid=27464): Launched 10:10:05.378805 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:05.932856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27466): Launched 10:10:06.250088 run osmo-stp_10.42.42.5(pid=27467): Launched 10:10:06.381140 tst emergency_mo_mt_call.py: using MSISDN 7681 10:10:06.543039 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:07.113728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27469): Launched 10:10:07.431005 run osmo-msc_10.42.42.6(pid=27470): Launched 10:10:07.607599 run osmo-stp_10.42.42.5(pid=27467): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27467)] 10:10:07.741462 run osmo-stp_10.42.42.5(pid=27467): stdout: | (launched: 2022-12-10_10:10:06.192828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:07.875275 run osmo-stp_10.42.42.5(pid=27467): stderr: | 20221210101006386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101006386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101006386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101006387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101006387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101006387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101006387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:08.007918 run osmo-stp_10.42.42.5(pid=27467): stdout: | (launched: 2022-12-10_10:10:06.192828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:08.134254 run osmo-stp_10.42.42.5(pid=27467): stderr: | 20221210101006386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101006386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101006386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101006387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101006387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101006387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101006387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:08.285147 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27467): Process ended prematurely: osmo-stp_10.42.42.5(pid=27467) [trial-2373↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27467)] [trial-2373↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 10:10:08.294090 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 10:10:08.321599 run osmo-hlr_10.42.42.2(pid=27464): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27464)] 10:10:08.371819 run osmo-hlr_10.42.42.2(pid=27464): stdout: | (launched: 2022-12-10_10:10:05.199011) 10:10:08.423560 run osmo-hlr_10.42.42.2(pid=27464): stderr: | 20221210101005397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101005397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101005397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101005397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101005397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101005398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101005409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101005418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101005418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101005418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:08.495589 run osmo-msc_10.42.42.6(pid=27470): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27470)] 10:10:08.545564 run osmo-msc_10.42.42.6(pid=27470): stdout: | (launched: 2022-12-10_10:10:07.373826) 10:10:08.597203 run osmo-msc_10.42.42.6(pid=27470): stderr: | 20221210101007699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101007699 DLGLOBAL DEBUG validating counter group 0x7f5efa5fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101007699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101007699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101007700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101007700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101007702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101007702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101007702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101007702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:08.649015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27463): Terminating (SIGTERM) 10:10:08.691001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27466): Terminating (SIGTERM) 10:10:08.732694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27469): Terminating (SIGTERM) 10:10:08.774951 --- ParallelTerminationStrategy: PID 27463 died... 10:10:08.794878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27463): Terminated: ok {rc=0} 10:10:08.841116 --- ParallelTerminationStrategy: PID 27466 died... 10:10:08.860393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27466): Terminated: ok {rc=0} 10:10:08.906929 --- ParallelTerminationStrategy: PID 27469 died... 10:10:08.926352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27469): Terminated: ok {rc=0} 10:10:09.014157 bus /sierra_3: Setting Powered False 10:10:10.113118 bus /sierra_3: Setting Powered False 10:10:11.227622 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 10:10:12.313220 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:12.325024 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 10:10:12.378506 tst emergency_preemptive_call.py: using LAC 27664 10:10:12.505227 tst emergency_preemptive_call.py: using RAC 124 10:10:12.624689 tst emergency_preemptive_call.py: using CellId 27664 10:10:12.741518 tst emergency_preemptive_call.py: using BVCI 27665 10:10:12.849293 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:12.860263 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:12.871041 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:12.882315 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:12.893586 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 10:10:12.904603 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:10:13.019126 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:10:13.136110 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:10:13.252341 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 10:10:13.365454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:13.829456 run create_hlr_db(pid=27472): Launched 10:10:13.951693 bus /sierra_2: Setting Powered False 10:10:15.011927 run create_hlr_db(pid=27472): Terminated: ok {rc=0} 10:10:15.448651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27474): Launched 10:10:15.767281 run osmo-hlr_10.42.42.2(pid=27475): Launched 10:10:15.922345 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:16.617546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27477): Launched 10:10:16.954057 run osmo-stp_10.42.42.5(pid=27478): Launched 10:10:17.234687 tst emergency_preemptive_call.py: using MSISDN 7682 10:10:17.418931 run osmo-msc_10.42.42.6: Starting osmo-msc 10:10:17.988626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27480): Launched 10:10:18.305312 run osmo-msc_10.42.42.6(pid=27481): Launched 10:10:18.483733 run osmo-stp_10.42.42.5(pid=27478): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27478)] 10:10:18.619163 run osmo-stp_10.42.42.5(pid=27478): stdout: | (launched: 2022-12-10_10:10:16.884272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:18.755565 run osmo-stp_10.42.42.5(pid=27478): stderr: | 20221210101017146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101017146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101017146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101017147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101017147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101017147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101017147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:18.890878 run osmo-stp_10.42.42.5(pid=27478): stdout: | (launched: 2022-12-10_10:10:16.884272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:19.018291 run osmo-stp_10.42.42.5(pid=27478): stderr: | 20221210101017146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101017146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101017146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101017147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101017147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101017147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101017147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:19.170401 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27478): Process ended prematurely: osmo-stp_10.42.42.5(pid=27478) [trial-2373↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27478)] [trial-2373↪emergency:trx-b200↪emergency_preemptive_call.py:32] 10:10:19.179421 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 10:10:19.208009 run osmo-hlr_10.42.42.2(pid=27475): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27475)] 10:10:19.259088 run osmo-hlr_10.42.42.2(pid=27475): stdout: | (launched: 2022-12-10_10:10:15.709952) 10:10:19.311978 run osmo-hlr_10.42.42.2(pid=27475): stderr: | 20221210101016003 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101016003 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101016004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101016004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101016004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101016004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101016031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101016048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101016048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101016048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:19.385823 run osmo-msc_10.42.42.6(pid=27481): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27481)] 10:10:19.436930 run osmo-msc_10.42.42.6(pid=27481): stdout: | (launched: 2022-12-10_10:10:18.248316) 10:10:19.489785 run osmo-msc_10.42.42.6(pid=27481): stderr: | 20221210101018571 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101018571 DLGLOBAL DEBUG validating counter group 0x7f69132e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101018571 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101018571 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101018571 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101018571 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101018573 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101018574 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101018574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101018574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:10:19.542600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27474): Terminating (SIGTERM) 10:10:19.585198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27477): Terminating (SIGTERM) 10:10:19.627922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27480): Terminating (SIGTERM) 10:10:19.671074 --- ParallelTerminationStrategy: PID 27474 died... 10:10:19.691538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27474): Terminated: ok {rc=0} 10:10:19.739284 --- ParallelTerminationStrategy: PID 27477 died... 10:10:19.759073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27477): Terminated: ok {rc=0} 10:10:19.805958 --- ParallelTerminationStrategy: PID 27480 died... 10:10:19.825649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27480): Terminated: ok {rc=0} 10:10:19.914529 bus /sierra_9: Setting Powered False 10:10:21.014913 bus /sierra_9: Setting Powered False 10:10:22.134297 bus /sierra_8: Setting Powered False 10:10:23.233573 bus /sierra_8: Setting Powered False 10:10:24.350549 bus /sierra_3: Setting Powered False 10:10:25.450247 bus /sierra_3: Setting Powered False 10:10:26.567882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-b200 --------------------------------------------------------------------- 10:10:27.846561 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:10:27.850954 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 10:10:27.883683 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 10:10:27.921950 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 10:10:28.008114 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 10:10:28.042175 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 10:10:28.081755 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 10:10:28.670141 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 10:10:28.719736 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:28.730549 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:10:28.777753 tst cs_paging_gprs_active.py: using LAC 27665 10:10:28.896097 tst cs_paging_gprs_active.py: using RAC 125 10:10:29.023166 tst cs_paging_gprs_active.py: using CellId 27665 10:10:29.150493 tst cs_paging_gprs_active.py: using BVCI 27666 10:10:29.268867 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.279974 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.290858 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.302037 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.312903 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.324035 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.335315 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.346347 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:29.357670 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:10:29.480789 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:10:29.602563 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:10:29.823018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:30.148415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27486): Launched 10:10:30.431056 run iperf3-srv_10.42.42.10(pid=27487): Launched 10:10:30.553247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:10:30.773450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:31.117612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27488): Launched 10:10:31.405942 run iperf3-srv_10.42.42.10(pid=27489): Launched 10:10:31.563575 tst cs_paging_gprs_active.py:38: start network... 10:10:31.809186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:32.322212 run create_hlr_db(pid=27490): Launched 10:10:32.446522 bus /sierra_2: Setting Powered False 10:10:33.510824 run create_hlr_db(pid=27490): Terminated: ok {rc=0} 10:10:33.945664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27492): Launched 10:10:34.249177 run osmo-hlr_10.42.42.2(pid=27493): Launched 10:10:34.364611 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:34.896786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27495): Launched 10:10:35.198577 run osmo-stp_10.42.42.5(pid=27496): Launched 10:10:35.314578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:10:35.841474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27498): Launched 10:10:35.958528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:10:36.215715 run patchelf(pid=27499): Launched 10:10:36.386170 run osmo-stp_10.42.42.5(pid=27496): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27496)] 10:10:36.515510 run osmo-stp_10.42.42.5(pid=27496): stdout: | (launched: 2022-12-10_10:10:35.143713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:36.646385 run osmo-stp_10.42.42.5(pid=27496): stderr: | 20221210101035313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101035313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101035314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101035314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101035314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101035315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101035315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:36.777098 run osmo-stp_10.42.42.5(pid=27496): stdout: | (launched: 2022-12-10_10:10:35.143713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:36.901712 run osmo-stp_10.42.42.5(pid=27496): stderr: | 20221210101035313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101035313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101035314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101035314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101035314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101035315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101035315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:37.049367 run patchelf(pid=27499): Terminating (SIGINT) 10:10:37.220752 run patchelf(pid=27499): Terminated: ok {rc=0} 10:10:37.344256 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27496): Process ended prematurely: osmo-stp_10.42.42.5(pid=27496) [trial-2373↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27496)] [trial-2373↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 10:10:37.353758 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:10:37.380739 run osmo-hlr_10.42.42.2(pid=27493): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27493)] 10:10:37.428392 run osmo-hlr_10.42.42.2(pid=27493): stdout: | (launched: 2022-12-10_10:10:34.194296) 10:10:37.477599 run osmo-hlr_10.42.42.2(pid=27493): stderr: | 20221210101034372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101034372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101034372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101034372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101034372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101034372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101034385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101034395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101034396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101034396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:37.527120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27486): Terminating (SIGTERM) 10:10:37.567498 run iperf3-srv_10.42.42.10(pid=27487): Terminating (SIGTERM) 10:10:37.607504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27488): Terminating (SIGTERM) 10:10:37.647388 run iperf3-srv_10.42.42.10(pid=27489): Terminating (SIGTERM) 10:10:37.687196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27492): Terminating (SIGTERM) 10:10:37.727159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27495): Terminating (SIGTERM) 10:10:37.767665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27498): Terminating (SIGTERM) 10:10:37.808104 --- ParallelTerminationStrategy: PID 27486 died... 10:10:37.827426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27486): Terminated: ok {rc=0} 10:10:37.872188 --- ParallelTerminationStrategy: PID 27487 died... 10:10:37.891106 run iperf3-srv_10.42.42.10(pid=27487): Terminated {rc=256} 10:10:37.935213 --- ParallelTerminationStrategy: PID 27488 died... 10:10:37.954017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27488): Terminated: ok {rc=0} 10:10:37.998044 --- ParallelTerminationStrategy: PID 27489 died... 10:10:38.016891 run iperf3-srv_10.42.42.10(pid=27489): Terminated {rc=256} 10:10:38.061008 --- ParallelTerminationStrategy: PID 27492 died... 10:10:38.079855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27492): Terminated: ok {rc=0} 10:10:38.124379 --- ParallelTerminationStrategy: PID 27495 died... 10:10:38.143196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27495): Terminated: ok {rc=0} 10:10:38.188127 --- ParallelTerminationStrategy: PID 27498 died... 10:10:38.206952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27498): Terminated: ok {rc=0} 10:10:38.293268 bus /gobi_0: Setting Powered False 10:10:39.395214 bus /gobi_0: Setting Powered False 10:10:40.510741 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200 iperf3.py ---------------------------------------------- 10:10:41.659837 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:41.671155 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:10:41.722749 tst iperf3.py: using LAC 27666 10:10:41.844080 tst iperf3.py: using RAC 126 10:10:41.965395 tst iperf3.py: using CellId 27666 10:10:42.084803 tst iperf3.py: using BVCI 27667 10:10:42.196342 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.207136 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.217726 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.228138 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.238665 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.248896 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.259423 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.269834 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:42.280242 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:10:42.398531 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:10:42.618196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:42.944906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27500): Launched 10:10:43.227231 run iperf3-srv_10.42.42.10(pid=27501): Launched 10:10:43.349180 tst iperf3.py:8: start network... 10:10:43.568318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:44.069741 run create_hlr_db(pid=27502): Launched 10:10:44.193605 bus /gobi_6: Setting Powered False 10:10:45.257973 run create_hlr_db(pid=27502): Terminated: ok {rc=0} 10:10:45.692094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Launched 10:10:46.033374 run osmo-hlr_10.42.42.2(pid=27505): Launched 10:10:46.291568 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:46.935376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Launched 10:10:47.261767 run osmo-stp_10.42.42.5(pid=27508): Launched 10:10:47.379476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:10:47.970883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27510): Launched 10:10:48.097464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:10:48.371031 run patchelf(pid=27511): Launched 10:10:48.552027 run osmo-stp_10.42.42.5(pid=27508): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] 10:10:48.690350 run osmo-stp_10.42.42.5(pid=27508): stdout: | (launched: 2022-12-10_10:10:47.191969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:48.830363 run osmo-stp_10.42.42.5(pid=27508): stderr: | 20221210101047518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101047518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101047519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101047519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101047520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101047520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101047520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:48.969904 run osmo-stp_10.42.42.5(pid=27508): stdout: | (launched: 2022-12-10_10:10:47.191969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:10:49.103297 run osmo-stp_10.42.42.5(pid=27508): stderr: | 20221210101047518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101047518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101047519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101047519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101047520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101047520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101047520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:10:49.261155 run patchelf(pid=27511): Terminating (SIGINT) 10:10:49.443626 run patchelf(pid=27511): Terminated: ok {rc=0} 10:10:49.575401 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27508): Process ended prematurely: osmo-stp_10.42.42.5(pid=27508) [trial-2373↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] [trial-2373↪gprs:trx-b200↪iperf3.py:8] 10:10:49.585647 tst iperf3.py:8: Test FAILED (8.0 sec) 10:10:49.614810 run osmo-hlr_10.42.42.2(pid=27505): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27505)] 10:10:49.665853 run osmo-hlr_10.42.42.2(pid=27505): stdout: | (launched: 2022-12-10_10:10:45.965487) 10:10:49.718124 run osmo-hlr_10.42.42.2(pid=27505): stderr: | 20221210101046328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101046328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101046328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101046328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101046328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101046328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101046346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101046354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101046355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101046355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:10:49.770677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27500): Terminating (SIGTERM) 10:10:49.813148 run iperf3-srv_10.42.42.10(pid=27501): Terminating (SIGTERM) 10:10:49.855555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Terminating (SIGTERM) 10:10:49.897934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Terminating (SIGTERM) 10:10:49.940209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27510): Terminating (SIGTERM) 10:10:49.982836 --- ParallelTerminationStrategy: PID 27500 died... 10:10:50.002917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27500): Terminated: ok {rc=0} 10:10:50.049905 --- ParallelTerminationStrategy: PID 27501 died... 10:10:50.069441 run iperf3-srv_10.42.42.10(pid=27501): Terminated {rc=256} 10:10:50.116483 --- ParallelTerminationStrategy: PID 27504 died... 10:10:50.136054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Terminated: ok {rc=0} 10:10:50.182492 --- ParallelTerminationStrategy: PID 27507 died... 10:10:50.201979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Terminated: ok {rc=0} 10:10:50.248336 --- ParallelTerminationStrategy: PID 27510 died... 10:10:50.267796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27510): Terminated: ok {rc=0} 10:10:50.356752 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 10:10:51.508602 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:51.520336 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:10:51.571880 tst iperf3m4.py: using LAC 27667 10:10:51.693631 tst iperf3m4.py: using RAC 127 10:10:51.813342 tst iperf3m4.py: using CellId 27667 10:10:51.933305 tst iperf3m4.py: using BVCI 27668 10:10:52.051700 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.063008 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.074238 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.085553 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.096540 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.107779 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.119223 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.130473 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:10:52.141813 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:10:52.261522 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:10:52.383567 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:10:52.498372 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:10:52.616492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:10:52.835827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:53.159899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27512): Launched 10:10:53.442188 run iperf3-srv_10.42.42.10(pid=27513): Launched 10:10:53.564077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:10:53.783727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:54.108319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27514): Launched 10:10:54.390011 run iperf3-srv_10.42.42.10(pid=27515): Launched 10:10:54.511589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:10:54.730959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:55.055517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27516): Launched 10:10:55.337787 run iperf3-srv_10.42.42.10(pid=27517): Launched 10:10:55.459669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:10:55.678061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:10:56.004679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27518): Launched 10:10:56.286293 run iperf3-srv_10.42.42.10(pid=27519): Launched 10:10:56.408177 tst iperf3m4.py:8: start network... 10:10:56.626198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:10:57.127107 run create_hlr_db(pid=27520): Launched 10:10:57.250846 bus /gobi_6: Setting Powered False 10:10:58.315053 run create_hlr_db(pid=27520): Terminated: ok {rc=0} 10:10:58.765704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27522): Launched 10:10:59.088503 run osmo-hlr_10.42.42.2(pid=27523): Launched 10:10:59.213137 run osmo-stp_10.42.42.5: Starting osmo-stp 10:10:59.777153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27525): Launched 10:11:00.100436 run osmo-stp_10.42.42.5(pid=27526): Launched 10:11:00.224555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:00.783280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27528): Launched 10:11:00.929491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:01.213763 run patchelf(pid=27529): Launched 10:11:01.400203 run osmo-stp_10.42.42.5(pid=27526): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27526)] 10:11:01.536124 run osmo-stp_10.42.42.5(pid=27526): stdout: | (launched: 2022-12-10_10:11:00.042194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:01.672455 run osmo-stp_10.42.42.5(pid=27526): stderr: | 20221210101100235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101100235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101100236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101100236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101100236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101100236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101100237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:01.809659 run osmo-stp_10.42.42.5(pid=27526): stdout: | (launched: 2022-12-10_10:11:00.042194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:01.939830 run osmo-stp_10.42.42.5(pid=27526): stderr: | 20221210101100235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101100235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101100236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101100236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101100236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101100236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101100237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:02.095617 run patchelf(pid=27529): Terminating (SIGINT) 10:11:02.269711 run patchelf(pid=27529): Terminated: ok {rc=0} 10:11:02.394405 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27526): Process ended prematurely: osmo-stp_10.42.42.5(pid=27526) [trial-2373↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27526)] [trial-2373↪gprs:trx-b200↪iperf3m4.py:8] 10:11:02.404136 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:11:02.432311 run osmo-hlr_10.42.42.2(pid=27523): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27523)] 10:11:02.481086 run osmo-hlr_10.42.42.2(pid=27523): stdout: | (launched: 2022-12-10_10:10:59.030425) 10:11:02.531553 run osmo-hlr_10.42.42.2(pid=27523): stderr: | 20221210101059227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101059228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101059228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101059228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101059228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101059228 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101059248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101059257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101059257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101059257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:02.582348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27512): Terminating (SIGTERM) 10:11:02.622956 run iperf3-srv_10.42.42.10(pid=27513): Terminating (SIGTERM) 10:11:02.663661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27514): Terminating (SIGTERM) 10:11:02.704334 run iperf3-srv_10.42.42.10(pid=27515): Terminating (SIGTERM) 10:11:02.745114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27516): Terminating (SIGTERM) 10:11:02.786564 run iperf3-srv_10.42.42.10(pid=27517): Terminating (SIGTERM) 10:11:02.827517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27518): Terminating (SIGTERM) 10:11:02.868382 run iperf3-srv_10.42.42.10(pid=27519): Terminating (SIGTERM) 10:11:02.909246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27522): Terminating (SIGTERM) 10:11:02.950110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27525): Terminating (SIGTERM) 10:11:02.990875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27528): Terminating (SIGTERM) 10:11:03.032150 --- ParallelTerminationStrategy: PID 27512 died... 10:11:03.051367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27512): Terminated: ok {rc=0} 10:11:03.096254 --- ParallelTerminationStrategy: PID 27513 died... 10:11:03.115388 run iperf3-srv_10.42.42.10(pid=27513): Terminated {rc=256} 10:11:03.160355 --- ParallelTerminationStrategy: PID 27514 died... 10:11:03.179434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27514): Terminated: ok {rc=0} 10:11:03.224192 --- ParallelTerminationStrategy: PID 27515 died... 10:11:03.243087 run iperf3-srv_10.42.42.10(pid=27515): Terminated {rc=256} 10:11:03.288146 --- ParallelTerminationStrategy: PID 27516 died... 10:11:03.307129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27516): Terminated: ok {rc=0} 10:11:03.352252 --- ParallelTerminationStrategy: PID 27517 died... 10:11:03.371201 run iperf3-srv_10.42.42.10(pid=27517): Terminated {rc=256} 10:11:03.415272 --- ParallelTerminationStrategy: PID 27518 died... 10:11:03.433962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27518): Terminated: ok {rc=0} 10:11:03.478128 --- ParallelTerminationStrategy: PID 27519 died... 10:11:03.496764 run iperf3-srv_10.42.42.10(pid=27519): Terminated {rc=256} 10:11:03.541204 --- ParallelTerminationStrategy: PID 27522 died... 10:11:03.559873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27522): Terminated: ok {rc=0} 10:11:03.603974 --- ParallelTerminationStrategy: PID 27525 died... 10:11:03.622886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27525): Terminated: ok {rc=0} 10:11:03.667070 --- ParallelTerminationStrategy: PID 27528 died... 10:11:03.685892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27528): Terminated: ok {rc=0} 10:11:03.772411 bus /gobi_4: Setting Powered False 10:11:04.873342 bus /gobi_4: Setting Powered False 10:11:05.989346 bus /gobi_1: Setting Powered False 10:11:07.089280 bus /gobi_1: Setting Powered False 10:11:08.202941 bus /gobi_0: Setting Powered False 10:11:09.301760 bus /gobi_0: Setting Powered False 10:11:10.419024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200 ping.py ---------------------------------------------- 10:11:11.521322 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:11.532734 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:11:11.587056 tst ping.py: using LAC 27668 10:11:11.704434 tst ping.py: using RAC 128 10:11:11.819635 tst ping.py: using CellId 27668 10:11:11.945254 tst ping.py: using BVCI 27669 10:11:12.060513 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:12.071651 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:12.082677 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:12.093868 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:12.105043 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:12.116204 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:12.127519 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:12.138773 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:11:12.254380 tst ping.py:19: start network... 10:11:12.454532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:12.916270 run create_hlr_db(pid=27530): Launched 10:11:13.038544 bus /gobi_6: Setting Powered False 10:11:14.098275 run create_hlr_db(pid=27530): Terminated: ok {rc=0} 10:11:14.514183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27532): Launched 10:11:14.812011 run osmo-hlr_10.42.42.2(pid=27533): Launched 10:11:14.925880 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:15.453722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27535): Launched 10:11:15.752146 run osmo-stp_10.42.42.5(pid=27536): Launched 10:11:15.867144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:16.478656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27538): Launched 10:11:16.602075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:16.865757 run patchelf(pid=27539): Launched 10:11:17.056098 run osmo-stp_10.42.42.5(pid=27536): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27536)] 10:11:17.197622 run osmo-stp_10.42.42.5(pid=27536): stdout: | (launched: 2022-12-10_10:11:15.697860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:17.341792 run osmo-stp_10.42.42.5(pid=27536): stderr: | 20221210101115933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101115933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101115934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101115934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101115935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101115935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101115935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:17.479702 run osmo-stp_10.42.42.5(pid=27536): stdout: | (launched: 2022-12-10_10:11:15.697860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:17.610713 run osmo-stp_10.42.42.5(pid=27536): stderr: | 20221210101115933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101115933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101115934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101115934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101115935 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101115935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101115935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:17.766389 run patchelf(pid=27539): Terminating (SIGINT) 10:11:17.945881 run patchelf(pid=27539): Terminated: ok {rc=0} 10:11:18.074793 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27536): Process ended prematurely: osmo-stp_10.42.42.5(pid=27536) [trial-2373↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27536)] [trial-2373↪gprs:trx-b200↪ping.py:22] 10:11:18.084348 tst ping.py:22: Test FAILED (6.6 sec) 10:11:18.113504 run osmo-hlr_10.42.42.2(pid=27533): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27533)] 10:11:18.164183 run osmo-hlr_10.42.42.2(pid=27533): stdout: | (launched: 2022-12-10_10:11:14.757800) 10:11:18.216825 run osmo-hlr_10.42.42.2(pid=27533): stderr: | 20221210101114934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101114934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101114934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101114934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101114934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101114934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101114946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101114957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101114957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101114957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:18.269694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27532): Terminating (SIGTERM) 10:11:18.311897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27535): Terminating (SIGTERM) 10:11:18.354287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27538): Terminating (SIGTERM) 10:11:18.396842 --- ParallelTerminationStrategy: PID 27532 died... 10:11:18.416996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27532): Terminated: ok {rc=0} 10:11:18.464345 --- ParallelTerminationStrategy: PID 27535 died... 10:11:18.484261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27535): Terminated: ok {rc=0} 10:11:18.531221 --- ParallelTerminationStrategy: PID 27538 died... 10:11:18.550928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27538): Terminated: ok {rc=0} 10:11:18.639602 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 10:11:19.728109 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:19.740260 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 10:11:19.792601 tst ping_idle_ping.py: using LAC 27669 10:11:19.912715 tst ping_idle_ping.py: using RAC 129 10:11:20.030860 tst ping_idle_ping.py: using CellId 27669 10:11:20.150720 tst ping_idle_ping.py: using BVCI 27670 10:11:20.260469 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:20.271213 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:20.281857 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:20.292312 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:20.302666 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:20.313137 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:20.323493 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 10:11:20.334021 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 10:11:20.450959 tst ping_idle_ping.py:24: start network... 10:11:20.666045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:21.161466 run create_hlr_db(pid=27540): Launched 10:11:21.285674 bus /gobi_6: Setting Powered False 10:11:22.345363 run create_hlr_db(pid=27540): Terminated: ok {rc=0} 10:11:22.774564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27542): Launched 10:11:23.072221 run osmo-hlr_10.42.42.2(pid=27543): Launched 10:11:23.186158 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:23.714832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27545): Launched 10:11:24.013886 run osmo-stp_10.42.42.5(pid=27546): Launched 10:11:24.128020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:24.659493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27548): Launched 10:11:24.774038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:25.024927 run patchelf(pid=27549): Launched 10:11:25.191673 run osmo-stp_10.42.42.5(pid=27546): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27546)] 10:11:25.317910 run osmo-stp_10.42.42.5(pid=27546): stdout: | (launched: 2022-12-10_10:11:23.959372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:25.445575 run osmo-stp_10.42.42.5(pid=27546): stderr: | 20221210101124130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101124130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101124131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101124131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101124131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101124132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101124132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:25.573675 run osmo-stp_10.42.42.5(pid=27546): stdout: | (launched: 2022-12-10_10:11:23.959372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:25.695933 run osmo-stp_10.42.42.5(pid=27546): stderr: | 20221210101124130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101124130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101124131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101124131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101124131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101124132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101124132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:25.840904 run patchelf(pid=27549): Terminating (SIGINT) 10:11:26.009455 run patchelf(pid=27549): Terminated: ok {rc=0} 10:11:26.130729 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27546): Process ended prematurely: osmo-stp_10.42.42.5(pid=27546) [trial-2373↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27546)] [trial-2373↪gprs:trx-b200↪ping_idle_ping.py:27] 10:11:26.139508 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:11:26.166350 run osmo-hlr_10.42.42.2(pid=27543): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27543)] 10:11:26.213748 run osmo-hlr_10.42.42.2(pid=27543): stdout: | (launched: 2022-12-10_10:11:23.018261) 10:11:26.262721 run osmo-hlr_10.42.42.2(pid=27543): stderr: | 20221210101123191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101123191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101123191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101123191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101123191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101123191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101123204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101123214 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101123214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101123214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:26.312056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27542): Terminating (SIGTERM) 10:11:26.351507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27545): Terminating (SIGTERM) 10:11:26.391007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27548): Terminating (SIGTERM) 10:11:26.430863 --- ParallelTerminationStrategy: PID 27542 died... 10:11:26.449979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27542): Terminated: ok {rc=0} 10:11:26.493568 --- ParallelTerminationStrategy: PID 27545 died... 10:11:26.512008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27545): Terminated: ok {rc=0} 10:11:26.555417 --- ParallelTerminationStrategy: PID 27548 died... 10:11:26.574001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27548): Terminated: ok {rc=0} 10:11:26.658578 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 10:11:27.968151 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:11:27.973259 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:11:28.006127 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:11:28.044349 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:11:28.130049 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:11:28.162462 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:11:28.200038 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:11:28.794829 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:11:28.843387 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:28.854198 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:11:28.905663 tst cs_paging_gprs_active.py: using LAC 27670 10:11:29.025406 tst cs_paging_gprs_active.py: using RAC 130 10:11:29.143659 tst cs_paging_gprs_active.py: using CellId 27670 10:11:29.261111 tst cs_paging_gprs_active.py: using BVCI 27671 10:11:29.371478 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.382427 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.393071 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.403775 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.414435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.425019 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.435739 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.446293 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:29.456937 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:29.576258 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:29.696326 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:11:29.916502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:30.241545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27555): Launched 10:11:30.524865 run iperf3-srv_10.42.42.10(pid=27556): Launched 10:11:30.646739 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:11:30.871328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:31.217066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27557): Launched 10:11:31.522234 run iperf3-srv_10.42.42.10(pid=27558): Launched 10:11:31.655535 tst cs_paging_gprs_active.py:38: start network... 10:11:31.880891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:32.388769 run create_hlr_db(pid=27559): Launched 10:11:32.514775 bus /gobi_6: Setting Powered False 10:11:33.578673 run create_hlr_db(pid=27559): Terminated: ok {rc=0} 10:11:34.029094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27561): Launched 10:11:34.354434 run osmo-hlr_10.42.42.2(pid=27562): Launched 10:11:34.479086 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:35.039549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27564): Launched 10:11:35.363238 run osmo-stp_10.42.42.5(pid=27565): Launched 10:11:35.487742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:36.047233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27567): Launched 10:11:36.171909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:36.445756 run patchelf(pid=27568): Launched 10:11:36.627554 run osmo-stp_10.42.42.5(pid=27565): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27565)] 10:11:36.766423 run osmo-stp_10.42.42.5(pid=27565): stdout: | (launched: 2022-12-10_10:11:35.304911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:36.906777 run osmo-stp_10.42.42.5(pid=27565): stderr: | 20221210101135498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101135498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101135498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101135499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101135499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101135499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101135499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:37.046785 run osmo-stp_10.42.42.5(pid=27565): stdout: | (launched: 2022-12-10_10:11:35.304911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:37.180436 run osmo-stp_10.42.42.5(pid=27565): stderr: | 20221210101135498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101135498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101135498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101135499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101135499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101135499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101135499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:37.339289 run patchelf(pid=27568): Terminating (SIGINT) 10:11:37.523440 run patchelf(pid=27568): Terminated: ok {rc=0} 10:11:37.656337 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27565): Process ended prematurely: osmo-stp_10.42.42.5(pid=27565) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27565)] [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:11:37.666564 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:11:37.695508 run osmo-hlr_10.42.42.2(pid=27562): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27562)] 10:11:37.745947 run osmo-hlr_10.42.42.2(pid=27562): stdout: | (launched: 2022-12-10_10:11:34.296259) 10:11:37.797888 run osmo-hlr_10.42.42.2(pid=27562): stderr: | 20221210101134493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101134493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101134493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101134493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101134493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101134493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101134506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101134515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101134515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101134515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:37.850219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27555): Terminating (SIGTERM) 10:11:37.892184 run iperf3-srv_10.42.42.10(pid=27556): Terminating (SIGTERM) 10:11:37.934111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27557): Terminating (SIGTERM) 10:11:37.976050 run iperf3-srv_10.42.42.10(pid=27558): Terminating (SIGTERM) 10:11:38.017820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27561): Terminating (SIGTERM) 10:11:38.060015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27564): Terminating (SIGTERM) 10:11:38.102141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27567): Terminating (SIGTERM) 10:11:38.144293 --- ParallelTerminationStrategy: PID 27555 died... 10:11:38.164213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27555): Terminated: ok {rc=0} 10:11:38.211140 --- ParallelTerminationStrategy: PID 27556 died... 10:11:38.230508 run iperf3-srv_10.42.42.10(pid=27556): Terminated {rc=256} 10:11:38.276512 --- ParallelTerminationStrategy: PID 27557 died... 10:11:38.295854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27557): Terminated: ok {rc=0} 10:11:38.342012 --- ParallelTerminationStrategy: PID 27558 died... 10:11:38.361315 run iperf3-srv_10.42.42.10(pid=27558): Terminated {rc=256} 10:11:38.407124 --- ParallelTerminationStrategy: PID 27561 died... 10:11:38.426446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27561): Terminated: ok {rc=0} 10:11:38.472885 --- ParallelTerminationStrategy: PID 27564 died... 10:11:38.492349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27564): Terminated: ok {rc=0} 10:11:38.538468 --- ParallelTerminationStrategy: PID 27567 died... 10:11:38.557816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27567): Terminated: ok {rc=0} 10:11:38.645642 bus /gobi_0: Setting Powered False 10:11:39.743737 bus /gobi_0: Setting Powered False 10:11:40.859499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:11:42.008232 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.020119 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:11:42.074808 tst iperf3.py: using LAC 27671 10:11:42.203004 tst iperf3.py: using RAC 131 10:11:42.331508 tst iperf3.py: using CellId 27671 10:11:42.451892 tst iperf3.py: using BVCI 27672 10:11:42.562606 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.573455 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.584094 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.595243 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.606394 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.617444 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.628603 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.639540 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:42.650838 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:42.769934 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:11:42.990022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:43.314674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27569): Launched 10:11:43.597260 run iperf3-srv_10.42.42.10(pid=27570): Launched 10:11:43.719099 tst iperf3.py:8: start network... 10:11:43.937913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:44.438203 run create_hlr_db(pid=27571): Launched 10:11:44.563013 bus /gobi_6: Setting Powered False 10:11:45.626752 run create_hlr_db(pid=27571): Terminated: ok {rc=0} 10:11:46.102186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Launched 10:11:46.527902 run osmo-hlr_10.42.42.2(pid=27574): Launched 10:11:46.713159 run osmo-stp_10.42.42.5: Starting osmo-stp 10:11:47.440260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Launched 10:11:47.744018 run osmo-stp_10.42.42.5(pid=27577): Launched 10:11:47.859471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:11:48.382009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27579): Launched 10:11:48.498411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:11:48.753593 run patchelf(pid=27580): Launched 10:11:48.923408 run osmo-stp_10.42.42.5(pid=27577): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] 10:11:49.052708 run osmo-stp_10.42.42.5(pid=27577): stdout: | (launched: 2022-12-10_10:11:47.689202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:49.183616 run osmo-stp_10.42.42.5(pid=27577): stderr: | 20221210101147858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101147858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101147858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101147859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101147859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101147859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101147859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:49.314538 run osmo-stp_10.42.42.5(pid=27577): stdout: | (launched: 2022-12-10_10:11:47.689202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:11:49.439546 run osmo-stp_10.42.42.5(pid=27577): stderr: | 20221210101147858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101147858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101147858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101147859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101147859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101147859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101147859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:11:49.587535 run patchelf(pid=27580): Terminating (SIGINT) 10:11:49.759422 run patchelf(pid=27580): Terminated: ok {rc=0} 10:11:49.883307 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27577): Process ended prematurely: osmo-stp_10.42.42.5(pid=27577) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 10:11:49.892638 tst iperf3.py:8: Test FAILED (7.9 sec) 10:11:49.919936 run osmo-hlr_10.42.42.2(pid=27574): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27574)] 10:11:49.968037 run osmo-hlr_10.42.42.2(pid=27574): stdout: | (launched: 2022-12-10_10:11:46.449125) 10:11:50.017722 run osmo-hlr_10.42.42.2(pid=27574): stderr: | 20221210101146795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101146795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101146795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101146795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101146795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101146795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101146816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101146833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101146833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101146833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:11:50.067645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27569): Terminating (SIGTERM) 10:11:50.108308 run iperf3-srv_10.42.42.10(pid=27570): Terminating (SIGTERM) 10:11:50.149315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Terminating (SIGTERM) 10:11:50.188833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Terminating (SIGTERM) 10:11:50.228810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27579): Terminating (SIGTERM) 10:11:50.268817 --- ParallelTerminationStrategy: PID 27569 died... 10:11:50.287941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27569): Terminated: ok {rc=0} 10:11:50.331935 --- ParallelTerminationStrategy: PID 27570 died... 10:11:50.350608 run iperf3-srv_10.42.42.10(pid=27570): Terminated {rc=256} 10:11:50.394177 --- ParallelTerminationStrategy: PID 27573 died... 10:11:50.412647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27573): Terminated: ok {rc=0} 10:11:50.456404 --- ParallelTerminationStrategy: PID 27576 died... 10:11:50.474893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27576): Terminated: ok {rc=0} 10:11:50.518670 --- ParallelTerminationStrategy: PID 27579 died... 10:11:50.537441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27579): Terminated: ok {rc=0} 10:11:50.624132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:11:51.773290 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:51.784496 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:11:51.836838 tst iperf3m4.py: using LAC 27672 10:11:51.958662 tst iperf3m4.py: using RAC 132 10:11:52.076834 tst iperf3m4.py: using CellId 27672 10:11:52.194726 tst iperf3m4.py: using BVCI 27673 10:11:52.306123 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.316910 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.327601 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.338274 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.348837 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.359518 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.370331 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.380874 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:11:52.391671 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:52.507896 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:52.628027 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:52.747285 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:11:52.867902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:11:53.088287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:53.414125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27581): Launched 10:11:53.698590 run iperf3-srv_10.42.42.10(pid=27582): Launched 10:11:53.821466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:11:54.040161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:54.365209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27583): Launched 10:11:54.647774 run iperf3-srv_10.42.42.10(pid=27584): Launched 10:11:54.770304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:11:54.989829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:55.314934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27585): Launched 10:11:55.596819 run iperf3-srv_10.42.42.10(pid=27586): Launched 10:11:55.718511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:11:55.937026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:11:56.261980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27587): Launched 10:11:56.544295 run iperf3-srv_10.42.42.10(pid=27588): Launched 10:11:56.665911 tst iperf3m4.py:8: start network... 10:11:56.884548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:11:57.385382 run create_hlr_db(pid=27589): Launched 10:11:57.509656 bus /gobi_6: Setting Powered False 10:11:58.573699 run create_hlr_db(pid=27589): Terminated: ok {rc=0} 10:11:59.024863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27591): Launched 10:11:59.350091 run osmo-hlr_10.42.42.2(pid=27592): Launched 10:11:59.474445 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:00.038637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27594): Launched 10:12:00.363606 run osmo-stp_10.42.42.5(pid=27595): Launched 10:12:00.487772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:01.077844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27597): Launched 10:12:01.215650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:01.530622 run patchelf(pid=27598): Launched 10:12:01.775393 run osmo-stp_10.42.42.5(pid=27595): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27595)] 10:12:01.917641 run osmo-stp_10.42.42.5(pid=27595): stdout: | (launched: 2022-12-10_10:12:00.305046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:02.060215 run osmo-stp_10.42.42.5(pid=27595): stderr: | 20221210101200499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101200499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101200499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101200500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101200500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101200500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101200500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:02.202327 run osmo-stp_10.42.42.5(pid=27595): stdout: | (launched: 2022-12-10_10:12:00.305046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:02.338813 run osmo-stp_10.42.42.5(pid=27595): stderr: | 20221210101200499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101200499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101200499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101200500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101200500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101200500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101200500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:02.496480 run patchelf(pid=27598): Terminating (SIGINT) 10:12:02.680246 run patchelf(pid=27598): Terminated: ok {rc=0} 10:12:02.812778 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27595): Process ended prematurely: osmo-stp_10.42.42.5(pid=27595) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27595)] [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 10:12:02.822998 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:12:02.853061 run osmo-hlr_10.42.42.2(pid=27592): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27592)] 10:12:02.903845 run osmo-hlr_10.42.42.2(pid=27592): stdout: | (launched: 2022-12-10_10:11:59.291372) 10:12:02.956449 run osmo-hlr_10.42.42.2(pid=27592): stderr: | 20221210101159488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101159488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101159488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101159488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101159488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101159488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101159502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101159510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101159510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101159510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:03.009672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27581): Terminating (SIGTERM) 10:12:03.052248 run iperf3-srv_10.42.42.10(pid=27582): Terminating (SIGTERM) 10:12:03.095192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27583): Terminating (SIGTERM) 10:12:03.138008 run iperf3-srv_10.42.42.10(pid=27584): Terminating (SIGTERM) 10:12:03.180535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27585): Terminating (SIGTERM) 10:12:03.223368 run iperf3-srv_10.42.42.10(pid=27586): Terminating (SIGTERM) 10:12:03.266026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27587): Terminating (SIGTERM) 10:12:03.308659 run iperf3-srv_10.42.42.10(pid=27588): Terminating (SIGTERM) 10:12:03.351282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27591): Terminating (SIGTERM) 10:12:03.393805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27594): Terminating (SIGTERM) 10:12:03.436211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27597): Terminating (SIGTERM) 10:12:03.478936 --- ParallelTerminationStrategy: PID 27581 died... 10:12:03.498639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27581): Terminated: ok {rc=0} 10:12:03.545740 --- ParallelTerminationStrategy: PID 27582 died... 10:12:03.565260 run iperf3-srv_10.42.42.10(pid=27582): Terminated {rc=256} 10:12:03.612393 --- ParallelTerminationStrategy: PID 27583 died... 10:12:03.632222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27583): Terminated: ok {rc=0} 10:12:03.679172 --- ParallelTerminationStrategy: PID 27584 died... 10:12:03.698803 run iperf3-srv_10.42.42.10(pid=27584): Terminated {rc=256} 10:12:03.745915 --- ParallelTerminationStrategy: PID 27585 died... 10:12:03.765488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27585): Terminated: ok {rc=0} 10:12:03.812540 --- ParallelTerminationStrategy: PID 27586 died... 10:12:03.832238 run iperf3-srv_10.42.42.10(pid=27586): Terminated {rc=256} 10:12:03.879132 --- ParallelTerminationStrategy: PID 27587 died... 10:12:03.898727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27587): Terminated: ok {rc=0} 10:12:03.945608 --- ParallelTerminationStrategy: PID 27588 died... 10:12:03.965348 run iperf3-srv_10.42.42.10(pid=27588): Terminated {rc=256} 10:12:04.012280 --- ParallelTerminationStrategy: PID 27591 died... 10:12:04.032118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27591): Terminated: ok {rc=0} 10:12:04.079126 --- ParallelTerminationStrategy: PID 27594 died... 10:12:04.099072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27594): Terminated: ok {rc=0} 10:12:04.146212 --- ParallelTerminationStrategy: PID 27597 died... 10:12:04.166036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27597): Terminated: ok {rc=0} 10:12:04.255128 bus /gobi_4: Setting Powered False 10:12:05.355133 bus /gobi_4: Setting Powered False 10:12:06.472145 bus /gobi_1: Setting Powered False 10:12:07.571788 bus /gobi_1: Setting Powered False 10:12:08.686457 bus /gobi_0: Setting Powered False 10:12:09.785869 bus /gobi_0: Setting Powered False 10:12:10.903028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 10:12:12.005513 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.016855 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:12:12.066870 tst ping.py: using LAC 27673 10:12:12.183037 tst ping.py: using RAC 133 10:12:12.299702 tst ping.py: using CellId 27673 10:12:12.416874 tst ping.py: using BVCI 27674 10:12:12.534936 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.546399 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.557602 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.570089 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.582002 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.593783 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.605802 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:12.617698 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:12.735254 tst ping.py:19: start network... 10:12:12.935131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:13.395238 run create_hlr_db(pid=27599): Launched 10:12:13.509264 bus /gobi_6: Setting Powered False 10:12:14.569223 run create_hlr_db(pid=27599): Terminated: ok {rc=0} 10:12:15.006877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Launched 10:12:15.326348 run osmo-hlr_10.42.42.2(pid=27602): Launched 10:12:15.449134 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:16.007937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Launched 10:12:16.331441 run osmo-stp_10.42.42.5(pid=27605): Launched 10:12:16.572282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:17.130938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27607): Launched 10:12:17.257873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:17.509387 run patchelf(pid=27608): Launched 10:12:17.675105 run osmo-stp_10.42.42.5(pid=27605): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] 10:12:17.800905 run osmo-stp_10.42.42.5(pid=27605): stdout: | (launched: 2022-12-10_10:12:16.266820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:17.928534 run osmo-stp_10.42.42.5(pid=27605): stderr: | 20221210101216590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101216590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101216590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101216590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101216591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101216591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101216591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:18.056566 run osmo-stp_10.42.42.5(pid=27605): stdout: | (launched: 2022-12-10_10:12:16.266820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:18.178470 run osmo-stp_10.42.42.5(pid=27605): stderr: | 20221210101216590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101216590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101216590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101216590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101216591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101216591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101216591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:18.322855 run patchelf(pid=27608): Terminating (SIGINT) 10:12:18.490849 run patchelf(pid=27608): Terminated: ok {rc=0} 10:12:18.611441 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27605): Process ended prematurely: osmo-stp_10.42.42.5(pid=27605) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 10:12:18.620320 tst ping.py:22: Test FAILED (6.6 sec) 10:12:18.647117 run osmo-hlr_10.42.42.2(pid=27602): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27602)] 10:12:18.694741 run osmo-hlr_10.42.42.2(pid=27602): stdout: | (launched: 2022-12-10_10:12:15.268867) 10:12:18.743877 run osmo-hlr_10.42.42.2(pid=27602): stderr: | 20221210101215464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101215464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101215464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101215464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101215464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101215464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101215480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101215488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101215488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101215488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:18.793420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Terminating (SIGTERM) 10:12:18.833343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Terminating (SIGTERM) 10:12:18.873121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27607): Terminating (SIGTERM) 10:12:18.913333 --- ParallelTerminationStrategy: PID 27601 died... 10:12:18.932544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Terminated: ok {rc=0} 10:12:18.976416 --- ParallelTerminationStrategy: PID 27604 died... 10:12:18.994854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Terminated: ok {rc=0} 10:12:19.038766 --- ParallelTerminationStrategy: PID 27607 died... 10:12:19.057555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27607): Terminated: ok {rc=0} 10:12:19.142888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:12:20.231729 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.243069 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:12:20.297747 tst ping_idle_ping.py: using LAC 27674 10:12:20.416185 tst ping_idle_ping.py: using RAC 134 10:12:20.530709 tst ping_idle_ping.py: using CellId 27674 10:12:20.648166 tst ping_idle_ping.py: using BVCI 27675 10:12:20.757613 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.768482 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.779161 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.789797 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.800328 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.810934 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.821631 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:12:20.832298 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:12:20.949143 tst ping_idle_ping.py:24: start network... 10:12:21.166022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:21.661451 run create_hlr_db(pid=27609): Launched 10:12:21.793212 bus /gobi_6: Setting Powered False 10:12:22.857115 run create_hlr_db(pid=27609): Terminated: ok {rc=0} 10:12:23.284787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27611): Launched 10:12:23.583057 run osmo-hlr_10.42.42.2(pid=27612): Launched 10:12:23.695938 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:24.225786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27614): Launched 10:12:24.526606 run osmo-stp_10.42.42.5(pid=27615): Launched 10:12:24.641912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:25.157600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27617): Launched 10:12:25.273178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:25.526307 run patchelf(pid=27618): Launched 10:12:25.692898 run osmo-stp_10.42.42.5(pid=27615): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27615)] 10:12:25.819647 run osmo-stp_10.42.42.5(pid=27615): stdout: | (launched: 2022-12-10_10:12:24.471606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:25.947988 run osmo-stp_10.42.42.5(pid=27615): stderr: | 20221210101224642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101224642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101224642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101224643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101224644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101224644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101224644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:26.076630 run osmo-stp_10.42.42.5(pid=27615): stdout: | (launched: 2022-12-10_10:12:24.471606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:26.199391 run osmo-stp_10.42.42.5(pid=27615): stderr: | 20221210101224642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101224642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101224642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101224643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101224644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101224644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101224644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:26.344893 run patchelf(pid=27618): Terminating (SIGINT) 10:12:26.514340 run patchelf(pid=27618): Terminated: ok {rc=0} 10:12:26.635796 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27615): Process ended prematurely: osmo-stp_10.42.42.5(pid=27615) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27615)] [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 10:12:26.644606 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:12:26.671501 run osmo-hlr_10.42.42.2(pid=27612): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27612)] 10:12:26.718995 run osmo-hlr_10.42.42.2(pid=27612): stdout: | (launched: 2022-12-10_10:12:23.529299) 10:12:26.768636 run osmo-hlr_10.42.42.2(pid=27612): stderr: | 20221210101223707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101223707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101223707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101223707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101223707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101223707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101223719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101223729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101223730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101223730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:26.818437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27611): Terminating (SIGTERM) 10:12:26.858412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27614): Terminating (SIGTERM) 10:12:26.898387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27617): Terminating (SIGTERM) 10:12:26.938389 --- ParallelTerminationStrategy: PID 27611 died... 10:12:26.957520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27611): Terminated: ok {rc=0} 10:12:27.001674 --- ParallelTerminationStrategy: PID 27614 died... 10:12:27.020083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27614): Terminated: ok {rc=0} 10:12:27.064229 --- ParallelTerminationStrategy: PID 27617 died... 10:12:27.082920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27617): Terminated: ok {rc=0} 10:12:27.166361 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:12:28.482373 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:12:28.489367 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:12:28.526281 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:12:28.566087 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:12:28.655122 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:12:28.689677 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:12:28.730150 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:12:29.325722 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:12:29.377606 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:29.388374 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:12:29.457020 tst cs_paging_gprs_active.py: using LAC 27675 10:12:29.587365 tst cs_paging_gprs_active.py: using RAC 135 10:12:29.707735 tst cs_paging_gprs_active.py: using CellId 27675 10:12:29.828108 tst cs_paging_gprs_active.py: using BVCI 27676 10:12:29.938297 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:29.949209 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:29.959851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:29.970694 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:29.981192 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:29.991738 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:30.002435 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:30.012827 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:30.023480 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:30.142164 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:30.262065 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:12:30.485096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:30.810872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27622): Launched 10:12:31.132835 run iperf3-srv_10.42.42.10(pid=27623): Launched 10:12:31.259954 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:12:31.487558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:31.828375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27624): Launched 10:12:32.129931 run iperf3-srv_10.42.42.10(pid=27625): Launched 10:12:32.260820 tst cs_paging_gprs_active.py:38: start network... 10:12:32.480030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:32.982188 run create_hlr_db(pid=27626): Launched 10:12:33.115643 bus /gobi_6: Setting Powered False 10:12:34.180614 run create_hlr_db(pid=27626): Terminated: ok {rc=0} 10:12:34.614186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27628): Launched 10:12:34.917694 run osmo-hlr_10.42.42.2(pid=27629): Launched 10:12:35.034266 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:35.557255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27631): Launched 10:12:35.860453 run osmo-stp_10.42.42.5(pid=27632): Launched 10:12:35.981257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:36.522275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27635): Launched 10:12:36.639265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:36.897649 run patchelf(pid=27636): Launched 10:12:37.068021 run osmo-stp_10.42.42.5(pid=27632): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27632)] 10:12:37.197286 run osmo-stp_10.42.42.5(pid=27632): stdout: | (launched: 2022-12-10_10:12:35.805549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:37.327566 run osmo-stp_10.42.42.5(pid=27632): stderr: | 20221210101235983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101235983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101235984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101235984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101235985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101235985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101235985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:37.458422 run osmo-stp_10.42.42.5(pid=27632): stdout: | (launched: 2022-12-10_10:12:35.805549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:37.583740 run osmo-stp_10.42.42.5(pid=27632): stderr: | 20221210101235983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101235983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101235984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101235984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101235985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101235985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101235985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:37.731443 run patchelf(pid=27636): Terminating (SIGINT) 10:12:37.903486 run patchelf(pid=27636): Terminated: ok {rc=0} 10:12:38.027600 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27632): Process ended prematurely: osmo-stp_10.42.42.5(pid=27632) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27632)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:12:38.036929 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:12:38.064022 run osmo-hlr_10.42.42.2(pid=27629): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27629)] 10:12:38.111325 run osmo-hlr_10.42.42.2(pid=27629): stdout: | (launched: 2022-12-10_10:12:34.862735) 10:12:38.160829 run osmo-hlr_10.42.42.2(pid=27629): stderr: | 20221210101235037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101235038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101235038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101235038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101235038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101235038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101235050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101235061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101235062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101235062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:38.210295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27622): Terminating (SIGTERM) 10:12:38.250211 run iperf3-srv_10.42.42.10(pid=27623): Terminating (SIGTERM) 10:12:38.289765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27624): Terminating (SIGTERM) 10:12:38.329538 run iperf3-srv_10.42.42.10(pid=27625): Terminating (SIGTERM) 10:12:38.369052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27628): Terminating (SIGTERM) 10:12:38.408667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27631): Terminating (SIGTERM) 10:12:38.448339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27635): Terminating (SIGTERM) 10:12:38.488233 --- ParallelTerminationStrategy: PID 27622 died... 10:12:38.507567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27622): Terminated: ok {rc=0} 10:12:38.551706 --- ParallelTerminationStrategy: PID 27623 died... 10:12:38.570214 run iperf3-srv_10.42.42.10(pid=27623): Terminated {rc=256} 10:12:38.614284 --- ParallelTerminationStrategy: PID 27624 died... 10:12:38.632877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27624): Terminated: ok {rc=0} 10:12:38.676537 --- ParallelTerminationStrategy: PID 27625 died... 10:12:38.695044 run iperf3-srv_10.42.42.10(pid=27625): Terminated {rc=256} 10:12:38.738370 --- ParallelTerminationStrategy: PID 27628 died... 10:12:38.756643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27628): Terminated: ok {rc=0} 10:12:38.800264 --- ParallelTerminationStrategy: PID 27631 died... 10:12:38.818742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27631): Terminated: ok {rc=0} 10:12:38.862186 --- ParallelTerminationStrategy: PID 27635 died... 10:12:38.880688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27635): Terminated: ok {rc=0} 10:12:38.966307 bus /gobi_0: Setting Powered False 10:12:40.066009 bus /gobi_0: Setting Powered False 10:12:41.181902 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:12:42.326602 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.337987 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:12:42.417319 tst iperf3.py: using LAC 27676 10:12:42.536513 tst iperf3.py: using RAC 136 10:12:42.656549 tst iperf3.py: using CellId 27676 10:12:42.773365 tst iperf3.py: using BVCI 27677 10:12:42.884092 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.895052 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.905689 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.916298 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.926841 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.937471 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.948103 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.958649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:42.969526 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:43.088603 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:12:43.307854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:43.631680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Launched 10:12:43.914287 run iperf3-srv_10.42.42.10(pid=27638): Launched 10:12:44.035909 tst iperf3.py:8: start network... 10:12:44.253889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:44.753569 run create_hlr_db(pid=27639): Launched 10:12:44.886754 bus /gobi_6: Setting Powered False 10:12:45.949213 run create_hlr_db(pid=27639): Terminated: ok {rc=0} 10:12:46.434564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27641): Launched 10:12:46.777758 run osmo-hlr_10.42.42.2(pid=27642): Launched 10:12:47.019591 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:47.635107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27644): Launched 10:12:47.936940 run osmo-stp_10.42.42.5(pid=27645): Launched 10:12:48.053503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:12:48.575847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27647): Launched 10:12:48.693063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:12:48.948059 run patchelf(pid=27648): Launched 10:12:49.116820 run osmo-stp_10.42.42.5(pid=27645): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27645)] 10:12:49.245570 run osmo-stp_10.42.42.5(pid=27645): stdout: | (launched: 2022-12-10_10:12:47.882483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:49.375533 run osmo-stp_10.42.42.5(pid=27645): stderr: | 20221210101248052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101248052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101248053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101248053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101248054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101248054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101248054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:49.505278 run osmo-stp_10.42.42.5(pid=27645): stdout: | (launched: 2022-12-10_10:12:47.882483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:12:49.629247 run osmo-stp_10.42.42.5(pid=27645): stderr: | 20221210101248052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101248052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101248053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101248053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101248054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101248054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101248054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:12:49.776042 run patchelf(pid=27648): Terminating (SIGINT) 10:12:49.946816 run patchelf(pid=27648): Terminated: ok {rc=0} 10:12:50.069978 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27645): Process ended prematurely: osmo-stp_10.42.42.5(pid=27645) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27645)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 10:12:50.079237 tst iperf3.py:8: Test FAILED (7.8 sec) 10:12:50.106463 run osmo-hlr_10.42.42.2(pid=27642): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27642)] 10:12:50.154145 run osmo-hlr_10.42.42.2(pid=27642): stdout: | (launched: 2022-12-10_10:12:46.709574) 10:12:50.203532 run osmo-hlr_10.42.42.2(pid=27642): stderr: | 20221210101247002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101247002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101247002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101247002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101247002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101247002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101247017 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101247032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101247032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101247032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:12:50.253532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Terminating (SIGTERM) 10:12:50.293773 run iperf3-srv_10.42.42.10(pid=27638): Terminating (SIGTERM) 10:12:50.333838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27641): Terminating (SIGTERM) 10:12:50.373510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27644): Terminating (SIGTERM) 10:12:50.413292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27647): Terminating (SIGTERM) 10:12:50.453705 --- ParallelTerminationStrategy: PID 27637 died... 10:12:50.472691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27637): Terminated: ok {rc=0} 10:12:50.516606 --- ParallelTerminationStrategy: PID 27638 died... 10:12:50.535091 run iperf3-srv_10.42.42.10(pid=27638): Terminated {rc=256} 10:12:50.578966 --- ParallelTerminationStrategy: PID 27641 died... 10:12:50.597383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27641): Terminated: ok {rc=0} 10:12:50.641492 --- ParallelTerminationStrategy: PID 27644 died... 10:12:50.660057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27644): Terminated: ok {rc=0} 10:12:50.704075 --- ParallelTerminationStrategy: PID 27647 died... 10:12:50.722519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27647): Terminated: ok {rc=0} 10:12:50.808176 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:12:51.957294 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:51.968592 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:12:52.039027 tst iperf3m4.py: using LAC 27677 10:12:52.158571 tst iperf3m4.py: using RAC 137 10:12:52.287233 tst iperf3m4.py: using CellId 27677 10:12:52.415152 tst iperf3m4.py: using BVCI 27678 10:12:52.533825 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.545443 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.556754 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.569260 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.581383 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.594478 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.606024 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.618122 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:12:52.630438 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:52.751504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:52.873375 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:52.993327 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:12:53.115974 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:12:53.321804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:53.628149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27649): Launched 10:12:53.894129 run iperf3-srv_10.42.42.10(pid=27650): Launched 10:12:54.008600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:12:54.212144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:54.516523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27651): Launched 10:12:54.783038 run iperf3-srv_10.42.42.10(pid=27652): Launched 10:12:54.897394 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:12:55.100813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:55.406546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27653): Launched 10:12:55.673141 run iperf3-srv_10.42.42.10(pid=27654): Launched 10:12:55.787251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:12:55.990218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:12:56.294658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27655): Launched 10:12:56.560351 run iperf3-srv_10.42.42.10(pid=27656): Launched 10:12:56.675243 tst iperf3m4.py:8: start network... 10:12:56.878954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:12:57.349815 run create_hlr_db(pid=27657): Launched 10:12:57.467190 bus /gobi_6: Setting Powered False 10:12:58.527730 run create_hlr_db(pid=27657): Terminated: ok {rc=0} 10:12:58.971728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27659): Launched 10:12:59.298203 run osmo-hlr_10.42.42.2(pid=27660): Launched 10:12:59.424209 run osmo-stp_10.42.42.5: Starting osmo-stp 10:12:59.986870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27662): Launched 10:13:00.311882 run osmo-stp_10.42.42.5(pid=27663): Launched 10:13:00.436883 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:01.022295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27665): Launched 10:13:01.155097 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:01.426332 run patchelf(pid=27666): Launched 10:13:01.677146 run osmo-stp_10.42.42.5(pid=27663): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27663)] 10:13:01.834655 run osmo-stp_10.42.42.5(pid=27663): stdout: | (launched: 2022-12-10_10:13:00.253448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:01.977920 run osmo-stp_10.42.42.5(pid=27663): stderr: | 20221210101300446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101300446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101300447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101300447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101300448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101300448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101300448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:02.120773 run osmo-stp_10.42.42.5(pid=27663): stdout: | (launched: 2022-12-10_10:13:00.253448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:02.256922 run osmo-stp_10.42.42.5(pid=27663): stderr: | 20221210101300446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101300446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101300447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101300447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101300448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101300448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101300448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:02.416192 run patchelf(pid=27666): Terminating (SIGINT) 10:13:02.599324 run patchelf(pid=27666): Terminated: ok {rc=0} 10:13:02.732584 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27663): Process ended prematurely: osmo-stp_10.42.42.5(pid=27663) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27663)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:13:02.743085 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:13:02.773213 run osmo-hlr_10.42.42.2(pid=27660): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27660)] 10:13:02.824894 run osmo-hlr_10.42.42.2(pid=27660): stdout: | (launched: 2022-12-10_10:12:59.239278) 10:13:02.877893 run osmo-hlr_10.42.42.2(pid=27660): stderr: | 20221210101259437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101259437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101259438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101259438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101259438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101259438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101259451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101259460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101259460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101259460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:02.931367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27649): Terminating (SIGTERM) 10:13:02.974437 run iperf3-srv_10.42.42.10(pid=27650): Terminating (SIGTERM) 10:13:03.017620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27651): Terminating (SIGTERM) 10:13:03.060746 run iperf3-srv_10.42.42.10(pid=27652): Terminating (SIGTERM) 10:13:03.103909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27653): Terminating (SIGTERM) 10:13:03.147122 run iperf3-srv_10.42.42.10(pid=27654): Terminating (SIGTERM) 10:13:03.190147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27655): Terminating (SIGTERM) 10:13:03.233251 run iperf3-srv_10.42.42.10(pid=27656): Terminating (SIGTERM) 10:13:03.276164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27659): Terminating (SIGTERM) 10:13:03.319117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27662): Terminating (SIGTERM) 10:13:03.362157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27665): Terminating (SIGTERM) 10:13:03.405577 --- ParallelTerminationStrategy: PID 27649 died... 10:13:03.426093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27649): Terminated: ok {rc=0} 10:13:03.474354 --- ParallelTerminationStrategy: PID 27650 died... 10:13:03.494419 run iperf3-srv_10.42.42.10(pid=27650): Terminated {rc=256} 10:13:03.542424 --- ParallelTerminationStrategy: PID 27651 died... 10:13:03.562468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27651): Terminated: ok {rc=0} 10:13:03.610368 --- ParallelTerminationStrategy: PID 27652 died... 10:13:03.630456 run iperf3-srv_10.42.42.10(pid=27652): Terminated {rc=256} 10:13:03.678375 --- ParallelTerminationStrategy: PID 27653 died... 10:13:03.698878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27653): Terminated: ok {rc=0} 10:13:03.746927 --- ParallelTerminationStrategy: PID 27654 died... 10:13:03.766888 run iperf3-srv_10.42.42.10(pid=27654): Terminated {rc=256} 10:13:03.814756 --- ParallelTerminationStrategy: PID 27655 died... 10:13:03.834999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27655): Terminated: ok {rc=0} 10:13:03.883173 --- ParallelTerminationStrategy: PID 27656 died... 10:13:03.903247 run iperf3-srv_10.42.42.10(pid=27656): Terminated {rc=256} 10:13:03.951123 --- ParallelTerminationStrategy: PID 27659 died... 10:13:03.971173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27659): Terminated: ok {rc=0} 10:13:04.019008 --- ParallelTerminationStrategy: PID 27662 died... 10:13:04.039162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27662): Terminated: ok {rc=0} 10:13:04.087140 --- ParallelTerminationStrategy: PID 27665 died... 10:13:04.107272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27665): Terminated: ok {rc=0} 10:13:04.197760 bus /gobi_4: Setting Powered False 10:13:05.297828 bus /gobi_4: Setting Powered False 10:13:06.415272 bus /gobi_1: Setting Powered False 10:13:07.514195 bus /gobi_1: Setting Powered False 10:13:08.630326 bus /gobi_0: Setting Powered False 10:13:09.726445 bus /gobi_0: Setting Powered False 10:13:10.844032 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:13:11.947742 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:11.959236 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:13:12.029398 tst ping.py: using LAC 27678 10:13:12.156105 tst ping.py: using RAC 138 10:13:12.281111 tst ping.py: using CellId 27678 10:13:12.408044 tst ping.py: using BVCI 27679 10:13:12.523902 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:12.535458 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:12.546851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:12.558604 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:12.569957 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:12.581497 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:12.592864 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:12.604326 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:12.721748 tst ping.py:19: start network... 10:13:12.938164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:13.432591 run create_hlr_db(pid=27667): Launched 10:13:13.554263 bus /gobi_6: Setting Powered False 10:13:14.617979 run create_hlr_db(pid=27667): Terminated: ok {rc=0} 10:13:15.046561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27669): Launched 10:13:15.344507 run osmo-hlr_10.42.42.2(pid=27670): Launched 10:13:15.458780 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:16.024815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27672): Launched 10:13:16.425763 run osmo-stp_10.42.42.5(pid=27673): Launched 10:13:16.668064 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:17.366481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27675): Launched 10:13:17.481540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:17.732760 run patchelf(pid=27676): Launched 10:13:17.899255 run osmo-stp_10.42.42.5(pid=27673): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27673)] 10:13:18.025226 run osmo-stp_10.42.42.5(pid=27673): stdout: | (launched: 2022-12-10_10:13:16.353177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:18.153186 run osmo-stp_10.42.42.5(pid=27673): stderr: | 20221210101316647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101316647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101316648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101316648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101316648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101316648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101316649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:18.281236 run osmo-stp_10.42.42.5(pid=27673): stdout: | (launched: 2022-12-10_10:13:16.353177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:18.403067 run osmo-stp_10.42.42.5(pid=27673): stderr: | 20221210101316647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101316647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101316648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101316648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101316648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101316648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101316649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:18.547667 run patchelf(pid=27676): Terminating (SIGINT) 10:13:18.714970 run patchelf(pid=27676): Terminated: ok {rc=0} 10:13:18.836040 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27673): Process ended prematurely: osmo-stp_10.42.42.5(pid=27673) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27673)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 10:13:18.844870 tst ping.py:22: Test FAILED (6.9 sec) 10:13:18.872049 run osmo-hlr_10.42.42.2(pid=27670): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27670)] 10:13:18.919868 run osmo-hlr_10.42.42.2(pid=27670): stdout: | (launched: 2022-12-10_10:13:15.290447) 10:13:18.969440 run osmo-hlr_10.42.42.2(pid=27670): stderr: | 20221210101315466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101315466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101315466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101315466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101315466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101315466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101315478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101315487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101315487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101315487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:19.019641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27669): Terminating (SIGTERM) 10:13:19.059771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27672): Terminating (SIGTERM) 10:13:19.099855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27675): Terminating (SIGTERM) 10:13:19.140178 --- ParallelTerminationStrategy: PID 27669 died... 10:13:19.159532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27669): Terminated: ok {rc=0} 10:13:19.203785 --- ParallelTerminationStrategy: PID 27672 died... 10:13:19.222700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27672): Terminated: ok {rc=0} 10:13:19.266721 --- ParallelTerminationStrategy: PID 27675 died... 10:13:19.285580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27675): Terminated: ok {rc=0} 10:13:19.371063 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:13:20.461575 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:20.473672 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:13:20.553067 tst ping_idle_ping.py: using LAC 27679 10:13:20.681297 tst ping_idle_ping.py: using RAC 139 10:13:20.808420 tst ping_idle_ping.py: using CellId 27679 10:13:20.931192 tst ping_idle_ping.py: using BVCI 27680 10:13:21.041774 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:21.052816 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:21.063627 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:21.074799 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:21.085839 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:21.096798 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:21.107924 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:13:21.118705 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:13:21.232936 tst ping_idle_ping.py:24: start network... 10:13:21.434277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:21.904366 run create_hlr_db(pid=27677): Launched 10:13:22.026728 bus /gobi_6: Setting Powered False 10:13:23.086571 run create_hlr_db(pid=27677): Terminated: ok {rc=0} 10:13:23.524612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27679): Launched 10:13:23.843513 run osmo-hlr_10.42.42.2(pid=27680): Launched 10:13:23.966330 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:24.520105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27682): Launched 10:13:24.839981 run osmo-stp_10.42.42.5(pid=27683): Launched 10:13:24.962818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:25.514949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27685): Launched 10:13:25.638362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:25.908217 run patchelf(pid=27686): Launched 10:13:26.086993 run osmo-stp_10.42.42.5(pid=27683): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27683)] 10:13:26.223317 run osmo-stp_10.42.42.5(pid=27683): stdout: | (launched: 2022-12-10_10:13:24.782266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:26.361037 run osmo-stp_10.42.42.5(pid=27683): stderr: | 20221210101324976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101324976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101324977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101324977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101324977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101324977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101324978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:26.499036 run osmo-stp_10.42.42.5(pid=27683): stdout: | (launched: 2022-12-10_10:13:24.782266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:26.630675 run osmo-stp_10.42.42.5(pid=27683): stderr: | 20221210101324976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101324976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101324977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101324977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101324977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101324977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101324978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:26.786199 run patchelf(pid=27686): Terminating (SIGINT) 10:13:26.966156 run patchelf(pid=27686): Terminated: ok {rc=0} 10:13:27.095310 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27683): Process ended prematurely: osmo-stp_10.42.42.5(pid=27683) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27683)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:13:27.104757 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:13:27.133609 run osmo-hlr_10.42.42.2(pid=27680): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27680)] 10:13:27.184170 run osmo-hlr_10.42.42.2(pid=27680): stdout: | (launched: 2022-12-10_10:13:23.785913) 10:13:27.236687 run osmo-hlr_10.42.42.2(pid=27680): stderr: | 20221210101323984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101323984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101323984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101323984 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101323984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101323984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101323996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101324004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101324005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101324005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:27.289741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27679): Terminating (SIGTERM) 10:13:27.332315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27682): Terminating (SIGTERM) 10:13:27.374804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27685): Terminating (SIGTERM) 10:13:27.417402 --- ParallelTerminationStrategy: PID 27679 died... 10:13:27.437564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27679): Terminated: ok {rc=0} 10:13:27.484827 --- ParallelTerminationStrategy: PID 27682 died... 10:13:27.504869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27682): Terminated: ok {rc=0} 10:13:27.551952 --- ParallelTerminationStrategy: PID 27685 died... 10:13:27.571436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27685): Terminated: ok {rc=0} 10:13:27.661037 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:13:28.973845 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:13:28.980635 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:13:29.016081 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:13:29.056565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:13:29.145583 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:13:29.179574 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:13:29.218903 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:13:29.815369 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:13:29.867925 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:29.879216 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:13:29.950725 tst cs_paging_gprs_active.py: using LAC 27680 10:13:30.078906 tst cs_paging_gprs_active.py: using RAC 140 10:13:30.206086 tst cs_paging_gprs_active.py: using CellId 27680 10:13:30.334033 tst cs_paging_gprs_active.py: using BVCI 27681 10:13:30.445792 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.456888 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.467949 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.479045 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.490087 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.501300 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.512303 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.523401 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:30.534406 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:30.654003 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:30.772258 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:13:30.986558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:31.311973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27690): Launched 10:13:31.592339 run iperf3-srv_10.42.42.10(pid=27691): Launched 10:13:31.724590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:13:31.935382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:32.245355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27692): Launched 10:13:32.511777 run iperf3-srv_10.42.42.10(pid=27693): Launched 10:13:32.626895 tst cs_paging_gprs_active.py:38: start network... 10:13:32.832096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:33.305154 run create_hlr_db(pid=27694): Launched 10:13:33.430303 bus /gobi_6: Setting Powered False 10:13:34.490705 run create_hlr_db(pid=27694): Terminated: ok {rc=0} 10:13:34.914160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27696): Launched 10:13:35.218626 run osmo-hlr_10.42.42.2(pid=27697): Launched 10:13:35.334745 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:35.861545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27699): Launched 10:13:36.166825 run osmo-stp_10.42.42.5(pid=27700): Launched 10:13:36.284239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:36.810566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27702): Launched 10:13:36.927671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:37.185913 run patchelf(pid=27703): Launched 10:13:37.355854 run osmo-stp_10.42.42.5(pid=27700): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27700)] 10:13:37.484429 run osmo-stp_10.42.42.5(pid=27700): stdout: | (launched: 2022-12-10_10:13:36.111658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:37.615302 run osmo-stp_10.42.42.5(pid=27700): stderr: | 20221210101336281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101336282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101336282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101336282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101336283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101336283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101336283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:37.745653 run osmo-stp_10.42.42.5(pid=27700): stdout: | (launched: 2022-12-10_10:13:36.111658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:37.870297 run osmo-stp_10.42.42.5(pid=27700): stderr: | 20221210101336281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101336282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101336282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101336282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101336283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101336283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101336283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:38.018127 run patchelf(pid=27703): Terminating (SIGINT) 10:13:38.189668 run patchelf(pid=27703): Terminated: ok {rc=0} 10:13:38.313421 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27700): Process ended prematurely: osmo-stp_10.42.42.5(pid=27700) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27700)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:13:38.322788 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:13:38.349835 run osmo-hlr_10.42.42.2(pid=27697): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27697)] 10:13:38.397381 run osmo-hlr_10.42.42.2(pid=27697): stdout: | (launched: 2022-12-10_10:13:35.163427) 10:13:38.446590 run osmo-hlr_10.42.42.2(pid=27697): stderr: | 20221210101335342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101335342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101335342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101335342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101335342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101335342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101335354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101335363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101335363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101335363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:38.496196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27690): Terminating (SIGTERM) 10:13:38.536124 run iperf3-srv_10.42.42.10(pid=27691): Terminating (SIGTERM) 10:13:38.575880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27692): Terminating (SIGTERM) 10:13:38.615669 run iperf3-srv_10.42.42.10(pid=27693): Terminating (SIGTERM) 10:13:38.655211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27696): Terminating (SIGTERM) 10:13:38.694891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27699): Terminating (SIGTERM) 10:13:38.734713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27702): Terminating (SIGTERM) 10:13:38.774707 --- ParallelTerminationStrategy: PID 27690 died... 10:13:38.793845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27690): Terminated: ok {rc=0} 10:13:38.837923 --- ParallelTerminationStrategy: PID 27691 died... 10:13:38.856514 run iperf3-srv_10.42.42.10(pid=27691): Terminated {rc=256} 10:13:38.900317 --- ParallelTerminationStrategy: PID 27692 died... 10:13:38.918958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27692): Terminated: ok {rc=0} 10:13:38.962679 --- ParallelTerminationStrategy: PID 27693 died... 10:13:38.981326 run iperf3-srv_10.42.42.10(pid=27693): Terminated {rc=256} 10:13:39.025595 --- ParallelTerminationStrategy: PID 27696 died... 10:13:39.044107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27696): Terminated: ok {rc=0} 10:13:39.087930 --- ParallelTerminationStrategy: PID 27699 died... 10:13:39.106533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27699): Terminated: ok {rc=0} 10:13:39.150194 --- ParallelTerminationStrategy: PID 27702 died... 10:13:39.168825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27702): Terminated: ok {rc=0} 10:13:39.252561 bus /gobi_0: Setting Powered False 10:13:40.350446 bus /gobi_0: Setting Powered False 10:13:41.466913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:13:42.617639 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:42.629775 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:13:42.706433 tst iperf3.py: using LAC 27681 10:13:42.836384 tst iperf3.py: using RAC 141 10:13:42.964373 tst iperf3.py: using CellId 27681 10:13:43.091438 tst iperf3.py: using BVCI 27682 10:13:43.210751 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.222106 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.233320 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.244571 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.255939 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.267393 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.278876 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.290164 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:43.301813 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:43.418555 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:13:43.623765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:43.928694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27704): Launched 10:13:44.194578 run iperf3-srv_10.42.42.10(pid=27705): Launched 10:13:44.309623 tst iperf3.py:8: start network... 10:13:44.514713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:44.986129 run create_hlr_db(pid=27706): Launched 10:13:45.111374 bus /gobi_6: Setting Powered False 10:13:46.174185 run create_hlr_db(pid=27706): Terminated: ok {rc=0} 10:13:46.660544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27708): Launched 10:13:47.054688 run osmo-hlr_10.42.42.2(pid=27709): Launched 10:13:47.262105 run osmo-stp_10.42.42.5: Starting osmo-stp 10:13:47.785732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27711): Launched 10:13:48.090727 run osmo-stp_10.42.42.5(pid=27712): Launched 10:13:48.206427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:13:48.730552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27714): Launched 10:13:48.847574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:13:49.104278 run patchelf(pid=27715): Launched 10:13:49.274416 run osmo-stp_10.42.42.5(pid=27712): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27712)] 10:13:49.403908 run osmo-stp_10.42.42.5(pid=27712): stdout: | (launched: 2022-12-10_10:13:48.035570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:49.534666 run osmo-stp_10.42.42.5(pid=27712): stderr: | 20221210101348206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101348206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101348206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101348206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101348209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101348209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101348209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:49.665217 run osmo-stp_10.42.42.5(pid=27712): stdout: | (launched: 2022-12-10_10:13:48.035570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:13:49.789873 run osmo-stp_10.42.42.5(pid=27712): stderr: | 20221210101348206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101348206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101348206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101348206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101348209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101348209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101348209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:13:49.937826 run patchelf(pid=27715): Terminating (SIGINT) 10:13:50.108476 run patchelf(pid=27715): Terminated: ok {rc=0} 10:13:50.231844 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27712): Process ended prematurely: osmo-stp_10.42.42.5(pid=27712) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27712)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 10:13:50.241304 tst iperf3.py:8: Test FAILED (7.7 sec) 10:13:50.268795 run osmo-hlr_10.42.42.2(pid=27709): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27709)] 10:13:50.317198 run osmo-hlr_10.42.42.2(pid=27709): stdout: | (launched: 2022-12-10_10:13:46.984742) 10:13:50.366827 run osmo-hlr_10.42.42.2(pid=27709): stderr: | 20221210101347223 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101347223 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101347223 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101347223 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101347223 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101347223 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101347235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101347251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101347251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101347251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:13:50.416680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27704): Terminating (SIGTERM) 10:13:50.456558 run iperf3-srv_10.42.42.10(pid=27705): Terminating (SIGTERM) 10:13:50.496638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27708): Terminating (SIGTERM) 10:13:50.536595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27711): Terminating (SIGTERM) 10:13:50.576630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27714): Terminating (SIGTERM) 10:13:50.616880 --- ParallelTerminationStrategy: PID 27704 died... 10:13:50.635914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27704): Terminated: ok {rc=0} 10:13:50.680254 --- ParallelTerminationStrategy: PID 27705 died... 10:13:50.698940 run iperf3-srv_10.42.42.10(pid=27705): Terminated {rc=256} 10:13:50.742689 --- ParallelTerminationStrategy: PID 27708 died... 10:13:50.761344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27708): Terminated: ok {rc=0} 10:13:50.805403 --- ParallelTerminationStrategy: PID 27711 died... 10:13:50.823929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27711): Terminated: ok {rc=0} 10:13:50.868139 --- ParallelTerminationStrategy: PID 27714 died... 10:13:50.886907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27714): Terminated: ok {rc=0} 10:13:50.972661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:13:52.126780 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.138970 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:13:52.214360 tst iperf3m4.py: using LAC 27682 10:13:52.341744 tst iperf3m4.py: using RAC 142 10:13:52.469061 tst iperf3m4.py: using CellId 27682 10:13:52.597625 tst iperf3m4.py: using BVCI 27683 10:13:52.716384 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.727980 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.739298 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.751393 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.763367 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.775409 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.787265 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.799164 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:13:52.811750 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:52.931807 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:53.054031 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:53.171456 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:13:53.291687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:13:53.511675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:53.836503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27716): Launched 10:13:54.119019 run iperf3-srv_10.42.42.10(pid=27717): Launched 10:13:54.241909 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:13:54.461609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:54.786868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27718): Launched 10:13:55.069749 run iperf3-srv_10.42.42.10(pid=27719): Launched 10:13:55.191731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:13:55.410675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:55.735394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27720): Launched 10:13:56.018412 run iperf3-srv_10.42.42.10(pid=27721): Launched 10:13:56.140576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:13:56.359814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:13:56.684786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27722): Launched 10:13:56.966912 run iperf3-srv_10.42.42.10(pid=27723): Launched 10:13:57.089571 tst iperf3m4.py:8: start network... 10:13:57.308749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:13:57.813759 run create_hlr_db(pid=27724): Launched 10:13:57.938569 bus /gobi_6: Setting Powered False 10:13:59.002950 run create_hlr_db(pid=27724): Terminated: ok {rc=0} 10:13:59.454832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27726): Launched 10:13:59.779169 run osmo-hlr_10.42.42.2(pid=27727): Launched 10:13:59.905036 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:00.466505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27729): Launched 10:14:00.789479 run osmo-stp_10.42.42.5(pid=27730): Launched 10:14:00.999308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:01.795112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27732): Launched 10:14:01.927762 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:02.205689 run patchelf(pid=27733): Launched 10:14:02.386096 run osmo-stp_10.42.42.5(pid=27730): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27730)] 10:14:02.515409 run osmo-stp_10.42.42.5(pid=27730): stdout: | (launched: 2022-12-10_10:14:00.731400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:02.646597 run osmo-stp_10.42.42.5(pid=27730): stderr: | 20221210101401011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101401011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101401012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101401012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101401015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101401015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101401015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:02.777494 run osmo-stp_10.42.42.5(pid=27730): stdout: | (launched: 2022-12-10_10:14:00.731400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:02.901720 run osmo-stp_10.42.42.5(pid=27730): stderr: | 20221210101401011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101401011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101401012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101401012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101401015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101401015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101401015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:03.049406 run patchelf(pid=27733): Terminating (SIGINT) 10:14:03.220873 run patchelf(pid=27733): Terminated: ok {rc=0} 10:14:03.344434 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27730): Process ended prematurely: osmo-stp_10.42.42.5(pid=27730) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27730)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:14:03.353934 tst iperf3m4.py:8: Test FAILED (11.3 sec) 10:14:03.381530 run osmo-hlr_10.42.42.2(pid=27727): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27727)] 10:14:03.429498 run osmo-hlr_10.42.42.2(pid=27727): stdout: | (launched: 2022-12-10_10:13:59.720537) 10:14:03.478941 run osmo-hlr_10.42.42.2(pid=27727): stderr: | 20221210101359920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101359920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101359920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101359920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101359920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101359920 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101359932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101359940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101359940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101359940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:03.529402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27716): Terminating (SIGTERM) 10:14:03.569385 run iperf3-srv_10.42.42.10(pid=27717): Terminating (SIGTERM) 10:14:03.609409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27718): Terminating (SIGTERM) 10:14:03.649590 run iperf3-srv_10.42.42.10(pid=27719): Terminating (SIGTERM) 10:14:03.689492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27720): Terminating (SIGTERM) 10:14:03.729458 run iperf3-srv_10.42.42.10(pid=27721): Terminating (SIGTERM) 10:14:03.769476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27722): Terminating (SIGTERM) 10:14:03.809681 run iperf3-srv_10.42.42.10(pid=27723): Terminating (SIGTERM) 10:14:03.849563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27726): Terminating (SIGTERM) 10:14:03.889651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27729): Terminating (SIGTERM) 10:14:03.929497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27732): Terminating (SIGTERM) 10:14:03.969528 --- ParallelTerminationStrategy: PID 27716 died... 10:14:03.988432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27716): Terminated: ok {rc=0} 10:14:04.033144 --- ParallelTerminationStrategy: PID 27717 died... 10:14:04.051844 run iperf3-srv_10.42.42.10(pid=27717): Terminated {rc=256} 10:14:04.096169 --- ParallelTerminationStrategy: PID 27718 died... 10:14:04.115052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27718): Terminated: ok {rc=0} 10:14:04.159294 --- ParallelTerminationStrategy: PID 27719 died... 10:14:04.177958 run iperf3-srv_10.42.42.10(pid=27719): Terminated {rc=256} 10:14:04.222119 --- ParallelTerminationStrategy: PID 27720 died... 10:14:04.241022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27720): Terminated: ok {rc=0} 10:14:04.285399 --- ParallelTerminationStrategy: PID 27721 died... 10:14:04.304083 run iperf3-srv_10.42.42.10(pid=27721): Terminated {rc=256} 10:14:04.348472 --- ParallelTerminationStrategy: PID 27722 died... 10:14:04.367394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27722): Terminated: ok {rc=0} 10:14:04.411818 --- ParallelTerminationStrategy: PID 27723 died... 10:14:04.430606 run iperf3-srv_10.42.42.10(pid=27723): Terminated {rc=256} 10:14:04.474796 --- ParallelTerminationStrategy: PID 27726 died... 10:14:04.493645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27726): Terminated: ok {rc=0} 10:14:04.538245 --- ParallelTerminationStrategy: PID 27729 died... 10:14:04.557142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27729): Terminated: ok {rc=0} 10:14:04.601613 --- ParallelTerminationStrategy: PID 27732 died... 10:14:04.620460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27732): Terminated: ok {rc=0} 10:14:04.707256 bus /gobi_4: Setting Powered False 10:14:05.808471 bus /gobi_4: Setting Powered False 10:14:06.923597 bus /gobi_1: Setting Powered False 10:14:08.022750 bus /gobi_1: Setting Powered False 10:14:09.137800 bus /gobi_0: Setting Powered False 10:14:10.236914 bus /gobi_0: Setting Powered False 10:14:11.352599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:14:12.457216 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:12.469154 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:14:12.543035 tst ping.py: using LAC 27683 10:14:12.662505 tst ping.py: using RAC 143 10:14:12.784185 tst ping.py: using CellId 27683 10:14:12.903483 tst ping.py: using BVCI 27684 10:14:13.012110 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:13.023547 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:13.034447 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:13.045331 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:13.056106 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:13.066804 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:13.077708 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:13.088498 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:13.201455 tst ping.py:19: start network... 10:14:13.401081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:13.861724 run create_hlr_db(pid=27734): Launched 10:14:13.983081 bus /gobi_6: Setting Powered False 10:14:15.043418 run create_hlr_db(pid=27734): Terminated: ok {rc=0} 10:14:15.460064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27736): Launched 10:14:15.758218 run osmo-hlr_10.42.42.2(pid=27737): Launched 10:14:15.888486 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:16.570616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27739): Launched 10:14:16.890857 run osmo-stp_10.42.42.5(pid=27740): Launched 10:14:17.134819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:17.750345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27742): Launched 10:14:17.864938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:18.116005 run patchelf(pid=27743): Launched 10:14:18.282059 run osmo-stp_10.42.42.5(pid=27740): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27740)] 10:14:18.408079 run osmo-stp_10.42.42.5(pid=27740): stdout: | (launched: 2022-12-10_10:14:16.822716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:18.535562 run osmo-stp_10.42.42.5(pid=27740): stderr: | 20221210101417149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101417149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101417149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101417150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101417150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101417150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101417150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:18.663122 run osmo-stp_10.42.42.5(pid=27740): stdout: | (launched: 2022-12-10_10:14:16.822716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:18.784550 run osmo-stp_10.42.42.5(pid=27740): stderr: | 20221210101417149 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101417149 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101417149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101417150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101417150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101417150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101417150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:18.928771 run patchelf(pid=27743): Terminating (SIGINT) 10:14:19.095533 run patchelf(pid=27743): Terminated: ok {rc=0} 10:14:19.215936 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27740): Process ended prematurely: osmo-stp_10.42.42.5(pid=27740) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27740)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 10:14:19.224727 tst ping.py:22: Test FAILED (6.8 sec) 10:14:19.251372 run osmo-hlr_10.42.42.2(pid=27737): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27737)] 10:14:19.298613 run osmo-hlr_10.42.42.2(pid=27737): stdout: | (launched: 2022-12-10_10:14:15.704205) 10:14:19.348031 run osmo-hlr_10.42.42.2(pid=27737): stderr: | 20221210101415982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101415982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101415982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101415982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101415982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101415982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101415999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101416011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101416011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101416011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:19.397386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27736): Terminating (SIGTERM) 10:14:19.436935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27739): Terminating (SIGTERM) 10:14:19.476445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27742): Terminating (SIGTERM) 10:14:19.516310 --- ParallelTerminationStrategy: PID 27736 died... 10:14:19.535243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27736): Terminated: ok {rc=0} 10:14:19.579025 --- ParallelTerminationStrategy: PID 27739 died... 10:14:19.597358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27739): Terminated: ok {rc=0} 10:14:19.641991 --- ParallelTerminationStrategy: PID 27742 died... 10:14:19.660207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27742): Terminated: ok {rc=0} 10:14:19.745258 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:14:20.833661 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:20.845088 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:14:20.919706 tst ping_idle_ping.py: using LAC 27684 10:14:21.036396 tst ping_idle_ping.py: using RAC 144 10:14:21.152479 tst ping_idle_ping.py: using CellId 27684 10:14:21.268164 tst ping_idle_ping.py: using BVCI 27685 10:14:21.377115 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:21.387929 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:21.398601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:21.409405 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:21.420005 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:21.430773 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:21.441561 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:14:21.452117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:14:21.565878 tst ping_idle_ping.py:24: start network... 10:14:21.765637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:22.229588 run create_hlr_db(pid=27745): Launched 10:14:22.351372 bus /gobi_6: Setting Powered False 10:14:23.410874 run create_hlr_db(pid=27745): Terminated: ok {rc=0} 10:14:23.849293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27747): Launched 10:14:24.170005 run osmo-hlr_10.42.42.2(pid=27748): Launched 10:14:24.292779 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:24.846711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27750): Launched 10:14:25.168116 run osmo-stp_10.42.42.5(pid=27751): Launched 10:14:25.291344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:25.843373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27753): Launched 10:14:25.966741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:26.235260 run patchelf(pid=27754): Launched 10:14:26.412834 run osmo-stp_10.42.42.5(pid=27751): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27751)] 10:14:26.548339 run osmo-stp_10.42.42.5(pid=27751): stdout: | (launched: 2022-12-10_10:14:25.110590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:26.685955 run osmo-stp_10.42.42.5(pid=27751): stderr: | 20221210101425303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101425303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101425303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101425304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101425304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101425304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101425304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:26.823472 run osmo-stp_10.42.42.5(pid=27751): stdout: | (launched: 2022-12-10_10:14:25.110590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:26.955093 run osmo-stp_10.42.42.5(pid=27751): stderr: | 20221210101425303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101425303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101425303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101425304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101425304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101425304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101425304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:27.110005 run patchelf(pid=27754): Terminating (SIGINT) 10:14:27.288900 run patchelf(pid=27754): Terminated: ok {rc=0} 10:14:27.418188 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27751): Process ended prematurely: osmo-stp_10.42.42.5(pid=27751) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27751)] [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:14:27.427565 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:14:27.456046 run osmo-hlr_10.42.42.2(pid=27748): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27748)] 10:14:27.506108 run osmo-hlr_10.42.42.2(pid=27748): stdout: | (launched: 2022-12-10_10:14:24.112527) 10:14:27.557990 run osmo-hlr_10.42.42.2(pid=27748): stderr: | 20221210101424308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101424308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101424308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101424308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101424308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101424308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101424320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101424328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101424328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101424328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:27.610172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27747): Terminating (SIGTERM) 10:14:27.652143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27750): Terminating (SIGTERM) 10:14:27.694518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27753): Terminating (SIGTERM) 10:14:27.736839 --- ParallelTerminationStrategy: PID 27747 died... 10:14:27.756808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27747): Terminated: ok {rc=0} 10:14:27.803540 --- ParallelTerminationStrategy: PID 27750 died... 10:14:27.823062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27750): Terminated: ok {rc=0} 10:14:27.870020 --- ParallelTerminationStrategy: PID 27753 died... 10:14:27.889653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27753): Terminated: ok {rc=0} 10:14:27.978382 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:14:29.287192 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:14:29.294402 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:14:29.329612 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:14:29.369956 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:14:29.458977 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:14:29.493274 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:14:29.533025 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:14:30.134936 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:14:30.188138 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.200095 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:14:30.254705 tst cs_paging_gprs_active.py: using LAC 27685 10:14:30.383001 tst cs_paging_gprs_active.py: using RAC 145 10:14:30.518254 tst cs_paging_gprs_active.py: using CellId 27685 10:14:30.656834 tst cs_paging_gprs_active.py: using BVCI 27686 10:14:30.777154 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.788926 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.800478 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.812286 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.824222 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.855387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.871266 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.883917 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:30.896523 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:14:31.028069 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:14:31.153570 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:14:31.441735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:31.854935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27759): Launched 10:14:32.155831 run iperf3-srv_10.42.42.10(pid=27760): Launched 10:14:32.284627 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:14:32.494190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:32.801468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27761): Launched 10:14:33.068344 run iperf3-srv_10.42.42.10(pid=27762): Launched 10:14:33.182495 tst cs_paging_gprs_active.py:38: start network... 10:14:33.387029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:33.860711 run create_hlr_db(pid=27763): Launched 10:14:33.986468 bus /gobi_6: Setting Powered False 10:14:35.047552 run create_hlr_db(pid=27763): Terminated: ok {rc=0} 10:14:35.472781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27765): Launched 10:14:35.777570 run osmo-hlr_10.42.42.2(pid=27766): Launched 10:14:35.893920 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:36.435554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27768): Launched 10:14:36.741409 run osmo-stp_10.42.42.5(pid=27769): Launched 10:14:36.857981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:37.384502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27771): Launched 10:14:37.502546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:37.759530 run patchelf(pid=27772): Launched 10:14:37.929719 run osmo-stp_10.42.42.5(pid=27769): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27769)] 10:14:38.058867 run osmo-stp_10.42.42.5(pid=27769): stdout: | (launched: 2022-12-10_10:14:36.684703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:38.189529 run osmo-stp_10.42.42.5(pid=27769): stderr: | 20221210101436857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101436857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101436857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101436858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101436858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101436858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101436858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:38.319822 run osmo-stp_10.42.42.5(pid=27769): stdout: | (launched: 2022-12-10_10:14:36.684703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:38.444578 run osmo-stp_10.42.42.5(pid=27769): stderr: | 20221210101436857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101436857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101436857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101436858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101436858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101436858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101436858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:38.592492 run patchelf(pid=27772): Terminating (SIGINT) 10:14:38.763888 run patchelf(pid=27772): Terminated: ok {rc=0} 10:14:38.887758 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27769): Process ended prematurely: osmo-stp_10.42.42.5(pid=27769) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27769)] [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:14:38.897227 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:14:38.924360 run osmo-hlr_10.42.42.2(pid=27766): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27766)] 10:14:38.972021 run osmo-hlr_10.42.42.2(pid=27766): stdout: | (launched: 2022-12-10_10:14:35.721986) 10:14:39.021489 run osmo-hlr_10.42.42.2(pid=27766): stderr: | 20221210101435901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101435901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101435902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101435902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101435902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101435902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101435914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101435923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101435923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101435923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:39.071445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27759): Terminating (SIGTERM) 10:14:39.111356 run iperf3-srv_10.42.42.10(pid=27760): Terminating (SIGTERM) 10:14:39.151306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27761): Terminating (SIGTERM) 10:14:39.191063 run iperf3-srv_10.42.42.10(pid=27762): Terminating (SIGTERM) 10:14:39.230733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27765): Terminating (SIGTERM) 10:14:39.270567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27768): Terminating (SIGTERM) 10:14:39.310429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27771): Terminating (SIGTERM) 10:14:39.350600 --- ParallelTerminationStrategy: PID 27759 died... 10:14:39.369653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27759): Terminated: ok {rc=0} 10:14:39.413826 --- ParallelTerminationStrategy: PID 27760 died... 10:14:39.432275 run iperf3-srv_10.42.42.10(pid=27760): Terminated {rc=256} 10:14:39.476620 --- ParallelTerminationStrategy: PID 27761 died... 10:14:39.495543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27761): Terminated: ok {rc=0} 10:14:39.539253 --- ParallelTerminationStrategy: PID 27762 died... 10:14:39.557732 run iperf3-srv_10.42.42.10(pid=27762): Terminated {rc=256} 10:14:39.601375 --- ParallelTerminationStrategy: PID 27765 died... 10:14:39.619886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27765): Terminated: ok {rc=0} 10:14:39.663446 --- ParallelTerminationStrategy: PID 27768 died... 10:14:39.682085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27768): Terminated: ok {rc=0} 10:14:39.725899 --- ParallelTerminationStrategy: PID 27771 died... 10:14:39.744606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27771): Terminated: ok {rc=0} 10:14:39.828487 bus /gobi_0: Setting Powered False 10:14:40.926651 bus /gobi_0: Setting Powered False 10:14:42.043189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:14:43.187116 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.198913 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:14:43.254031 tst iperf3.py: using LAC 27686 10:14:43.375074 tst iperf3.py: using RAC 146 10:14:43.496329 tst iperf3.py: using CellId 27686 10:14:43.620567 tst iperf3.py: using BVCI 27687 10:14:43.732684 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.744016 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.755090 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.766144 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.777114 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.788063 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.799162 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.810030 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:43.821161 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:14:43.935597 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:14:44.139776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:44.444625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27773): Launched 10:14:44.709866 run iperf3-srv_10.42.42.10(pid=27774): Launched 10:14:44.824517 tst iperf3.py:8: start network... 10:14:45.029357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:45.501701 run create_hlr_db(pid=27775): Launched 10:14:45.626989 bus /gobi_6: Setting Powered False 10:14:46.686207 run create_hlr_db(pid=27775): Terminated: ok {rc=0} 10:14:47.123638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27777): Launched 10:14:47.436309 run osmo-hlr_10.42.42.2(pid=27778): Launched 10:14:47.553609 run osmo-stp_10.42.42.5: Starting osmo-stp 10:14:48.077375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27780): Launched 10:14:48.381550 run osmo-stp_10.42.42.5(pid=27781): Launched 10:14:48.497273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:14:49.023285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27783): Launched 10:14:49.140644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:14:49.397061 run patchelf(pid=27784): Launched 10:14:49.567069 run osmo-stp_10.42.42.5(pid=27781): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27781)] 10:14:49.695969 run osmo-stp_10.42.42.5(pid=27781): stdout: | (launched: 2022-12-10_10:14:48.326281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:49.826616 run osmo-stp_10.42.42.5(pid=27781): stderr: | 20221210101448496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101448496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101448496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101448497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101448499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101448499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101448499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:49.956756 run osmo-stp_10.42.42.5(pid=27781): stdout: | (launched: 2022-12-10_10:14:48.326281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:14:50.080818 run osmo-stp_10.42.42.5(pid=27781): stderr: | 20221210101448496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101448496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101448496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101448497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101448499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101448499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101448499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:14:50.228182 run patchelf(pid=27784): Terminating (SIGINT) 10:14:50.399041 run patchelf(pid=27784): Terminated: ok {rc=0} 10:14:50.522342 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27781): Process ended prematurely: osmo-stp_10.42.42.5(pid=27781) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27781)] [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:14:50.531604 tst iperf3.py:8: Test FAILED (7.4 sec) 10:14:50.558848 run osmo-hlr_10.42.42.2(pid=27778): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27778)] 10:14:50.606172 run osmo-hlr_10.42.42.2(pid=27778): stdout: | (launched: 2022-12-10_10:14:47.380753) 10:14:50.655351 run osmo-hlr_10.42.42.2(pid=27778): stderr: | 20221210101447559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101447559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101447560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101447560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101447560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101447560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101447571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101447580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101447580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101447581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:14:50.704884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27773): Terminating (SIGTERM) 10:14:50.744500 run iperf3-srv_10.42.42.10(pid=27774): Terminating (SIGTERM) 10:14:50.784045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27777): Terminating (SIGTERM) 10:14:50.823843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27780): Terminating (SIGTERM) 10:14:50.863461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27783): Terminating (SIGTERM) 10:14:50.903347 --- ParallelTerminationStrategy: PID 27773 died... 10:14:50.922438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27773): Terminated: ok {rc=0} 10:14:50.966524 --- ParallelTerminationStrategy: PID 27774 died... 10:14:50.984939 run iperf3-srv_10.42.42.10(pid=27774): Terminated {rc=256} 10:14:51.028683 --- ParallelTerminationStrategy: PID 27777 died... 10:14:51.047398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27777): Terminated: ok {rc=0} 10:14:51.091262 --- ParallelTerminationStrategy: PID 27780 died... 10:14:51.109949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27780): Terminated: ok {rc=0} 10:14:51.154276 --- ParallelTerminationStrategy: PID 27783 died... 10:14:51.172789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27783): Terminated: ok {rc=0} 10:14:51.258649 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:14:52.406498 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:52.418278 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:14:52.474850 tst iperf3m4.py: using LAC 27687 10:14:52.592800 tst iperf3m4.py: using RAC 147 10:14:52.710935 tst iperf3m4.py: using CellId 27687 10:14:52.830158 tst iperf3m4.py: using BVCI 27688 10:14:52.939463 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:52.950853 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:52.962006 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:52.973469 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:52.984506 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:52.995685 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:53.006966 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:53.018014 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:14:53.029208 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:14:53.145201 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:14:53.268932 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:14:53.387729 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:14:53.504923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:14:53.709397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:54.014359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27785): Launched 10:14:54.279027 run iperf3-srv_10.42.42.10(pid=27786): Launched 10:14:54.392671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:14:54.595373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:54.900017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27787): Launched 10:14:55.164902 run iperf3-srv_10.42.42.10(pid=27788): Launched 10:14:55.279208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:14:55.482358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:55.787137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27789): Launched 10:14:56.051708 run iperf3-srv_10.42.42.10(pid=27790): Launched 10:14:56.165900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:14:56.368349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:14:56.672285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27791): Launched 10:14:56.936484 run iperf3-srv_10.42.42.10(pid=27792): Launched 10:14:57.050376 tst iperf3m4.py:8: start network... 10:14:57.253240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:14:57.723060 run create_hlr_db(pid=27793): Launched 10:14:57.846925 bus /gobi_6: Setting Powered False 10:14:58.907365 run create_hlr_db(pid=27793): Terminated: ok {rc=0} 10:14:59.328327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27795): Launched 10:14:59.631167 run osmo-hlr_10.42.42.2(pid=27796): Launched 10:14:59.747608 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:00.292533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27798): Launched 10:15:00.595851 run osmo-stp_10.42.42.5(pid=27799): Launched 10:15:00.711334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:01.246387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27801): Launched 10:15:01.375386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:01.642345 run patchelf(pid=27802): Launched 10:15:01.831125 run osmo-stp_10.42.42.5(pid=27799): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27799)] 10:15:01.974663 run osmo-stp_10.42.42.5(pid=27799): stdout: | (launched: 2022-12-10_10:15:00.540838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:02.111815 run osmo-stp_10.42.42.5(pid=27799): stderr: | 20221210101500712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101500712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101500712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101500712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101500713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101500713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101500713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:02.244331 run osmo-stp_10.42.42.5(pid=27799): stdout: | (launched: 2022-12-10_10:15:00.540838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:02.370171 run osmo-stp_10.42.42.5(pid=27799): stderr: | 20221210101500712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101500712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101500712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101500712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101500713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101500713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101500713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:02.517179 run patchelf(pid=27802): Terminating (SIGINT) 10:15:02.687642 run patchelf(pid=27802): Terminated: ok {rc=0} 10:15:02.810967 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27799): Process ended prematurely: osmo-stp_10.42.42.5(pid=27799) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27799)] [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:15:02.820472 tst iperf3m4.py:8: Test FAILED (10.5 sec) 10:15:02.848101 run osmo-hlr_10.42.42.2(pid=27796): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27796)] 10:15:02.895814 run osmo-hlr_10.42.42.2(pid=27796): stdout: | (launched: 2022-12-10_10:14:59.576126) 10:15:02.945384 run osmo-hlr_10.42.42.2(pid=27796): stderr: | 20221210101459754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101459754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101459754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101459755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101459755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101459755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101459767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101459778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101459778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101459778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:02.994964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27785): Terminating (SIGTERM) 10:15:03.034726 run iperf3-srv_10.42.42.10(pid=27786): Terminating (SIGTERM) 10:15:03.074582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27787): Terminating (SIGTERM) 10:15:03.114377 run iperf3-srv_10.42.42.10(pid=27788): Terminating (SIGTERM) 10:15:03.154047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27789): Terminating (SIGTERM) 10:15:03.193782 run iperf3-srv_10.42.42.10(pid=27790): Terminating (SIGTERM) 10:15:03.233401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27791): Terminating (SIGTERM) 10:15:03.273272 run iperf3-srv_10.42.42.10(pid=27792): Terminating (SIGTERM) 10:15:03.312706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27795): Terminating (SIGTERM) 10:15:03.352198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27798): Terminating (SIGTERM) 10:15:03.391715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27801): Terminating (SIGTERM) 10:15:03.431493 --- ParallelTerminationStrategy: PID 27785 died... 10:15:03.450565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27785): Terminated: ok {rc=0} 10:15:03.494570 --- ParallelTerminationStrategy: PID 27786 died... 10:15:03.513609 run iperf3-srv_10.42.42.10(pid=27786): Terminated {rc=256} 10:15:03.557773 --- ParallelTerminationStrategy: PID 27787 died... 10:15:03.576722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27787): Terminated: ok {rc=0} 10:15:03.620593 --- ParallelTerminationStrategy: PID 27788 died... 10:15:03.639246 run iperf3-srv_10.42.42.10(pid=27788): Terminated {rc=256} 10:15:03.683431 --- ParallelTerminationStrategy: PID 27789 died... 10:15:03.702207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27789): Terminated: ok {rc=0} 10:15:03.745821 --- ParallelTerminationStrategy: PID 27790 died... 10:15:03.764236 run iperf3-srv_10.42.42.10(pid=27790): Terminated {rc=256} 10:15:03.807663 --- ParallelTerminationStrategy: PID 27791 died... 10:15:03.826344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27791): Terminated: ok {rc=0} 10:15:03.870073 --- ParallelTerminationStrategy: PID 27792 died... 10:15:03.888505 run iperf3-srv_10.42.42.10(pid=27792): Terminated {rc=256} 10:15:03.932031 --- ParallelTerminationStrategy: PID 27795 died... 10:15:03.950661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27795): Terminated: ok {rc=0} 10:15:03.995179 --- ParallelTerminationStrategy: PID 27798 died... 10:15:04.013847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27798): Terminated: ok {rc=0} 10:15:04.057536 --- ParallelTerminationStrategy: PID 27801 died... 10:15:04.076115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27801): Terminated: ok {rc=0} 10:15:04.161202 bus /gobi_4: Setting Powered False 10:15:05.259801 bus /gobi_4: Setting Powered False 10:15:06.373582 bus /gobi_1: Setting Powered False 10:15:07.471844 bus /gobi_1: Setting Powered False 10:15:08.587294 bus /gobi_0: Setting Powered False 10:15:09.686789 bus /gobi_0: Setting Powered False 10:15:10.804070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:15:11.908800 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:11.921499 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:15:11.980191 tst ping.py: using LAC 27688 10:15:12.102496 tst ping.py: using RAC 148 10:15:12.218878 tst ping.py: using CellId 27688 10:15:12.334513 tst ping.py: using BVCI 27689 10:15:12.443675 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:12.455200 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:12.466641 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:12.477799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:12.488830 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:12.499955 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:12.511299 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:12.522458 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:15:12.639521 tst ping.py:19: start network... 10:15:12.856822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:13.351250 run create_hlr_db(pid=27806): Launched 10:15:13.472518 bus /gobi_6: Setting Powered False 10:15:14.536697 run create_hlr_db(pid=27806): Terminated: ok {rc=0} 10:15:14.965370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27808): Launched 10:15:15.264134 run osmo-hlr_10.42.42.2(pid=27809): Launched 10:15:15.378839 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:15.897907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27811): Launched 10:15:16.215781 run osmo-stp_10.42.42.5(pid=27812): Launched 10:15:16.451519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:17.203983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27814): Launched 10:15:17.322486 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:17.574924 run patchelf(pid=27815): Launched 10:15:17.741276 run osmo-stp_10.42.42.5(pid=27812): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27812)] 10:15:17.868365 run osmo-stp_10.42.42.5(pid=27812): stdout: | (launched: 2022-12-10_10:15:16.152689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:17.996591 run osmo-stp_10.42.42.5(pid=27812): stderr: | 20221210101516491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101516492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101516492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101516492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101516493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101516493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101516493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:18.125128 run osmo-stp_10.42.42.5(pid=27812): stdout: | (launched: 2022-12-10_10:15:16.152689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:18.247360 run osmo-stp_10.42.42.5(pid=27812): stderr: | 20221210101516491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101516492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101516492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101516492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101516493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101516493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101516493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:18.392310 run patchelf(pid=27815): Terminating (SIGINT) 10:15:18.559957 run patchelf(pid=27815): Terminated: ok {rc=0} 10:15:18.681190 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27812): Process ended prematurely: osmo-stp_10.42.42.5(pid=27812) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27812)] [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:15:18.689893 tst ping.py:22: Test FAILED (6.8 sec) 10:15:18.716729 run osmo-hlr_10.42.42.2(pid=27809): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27809)] 10:15:18.763973 run osmo-hlr_10.42.42.2(pid=27809): stdout: | (launched: 2022-12-10_10:15:15.209416) 10:15:18.813168 run osmo-hlr_10.42.42.2(pid=27809): stderr: | 20221210101515387 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101515388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101515388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101515388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101515388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101515388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101515404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101515414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101515414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101515414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:18.862798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27808): Terminating (SIGTERM) 10:15:18.902485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27811): Terminating (SIGTERM) 10:15:18.942095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27814): Terminating (SIGTERM) 10:15:18.981948 --- ParallelTerminationStrategy: PID 27808 died... 10:15:19.001148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27808): Terminated: ok {rc=0} 10:15:19.045219 --- ParallelTerminationStrategy: PID 27811 died... 10:15:19.063766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27811): Terminated: ok {rc=0} 10:15:19.108657 --- ParallelTerminationStrategy: PID 27814 died... 10:15:19.127506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27814): Terminated: ok {rc=0} 10:15:19.214076 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:15:20.304275 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.316419 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:15:20.371584 tst ping_idle_ping.py: using LAC 27689 10:15:20.490532 tst ping_idle_ping.py: using RAC 149 10:15:20.611435 tst ping_idle_ping.py: using CellId 27689 10:15:20.738827 tst ping_idle_ping.py: using BVCI 27690 10:15:20.857463 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.869358 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.881025 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.892848 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.904688 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.916532 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.928563 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:15:20.940402 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:15:21.055462 tst ping_idle_ping.py:24: start network... 10:15:21.258455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:21.725400 run create_hlr_db(pid=27816): Launched 10:15:21.848864 bus /gobi_6: Setting Powered False 10:15:22.909475 run create_hlr_db(pid=27816): Terminated: ok {rc=0} 10:15:23.328554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27818): Launched 10:15:23.629273 run osmo-hlr_10.42.42.2(pid=27819): Launched 10:15:23.744251 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:24.278471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27821): Launched 10:15:24.579031 run osmo-stp_10.42.42.5(pid=27822): Launched 10:15:24.694593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:25.229721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27824): Launched 10:15:25.344771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:25.597728 run patchelf(pid=27825): Launched 10:15:25.765683 run osmo-stp_10.42.42.5(pid=27822): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27822)] 10:15:25.893865 run osmo-stp_10.42.42.5(pid=27822): stdout: | (launched: 2022-12-10_10:15:24.524266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:26.022482 run osmo-stp_10.42.42.5(pid=27822): stderr: | 20221210101524693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101524693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101524694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101524694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101524694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101524695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101524695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:26.151308 run osmo-stp_10.42.42.5(pid=27822): stdout: | (launched: 2022-12-10_10:15:24.524266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:26.274339 run osmo-stp_10.42.42.5(pid=27822): stderr: | 20221210101524693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101524693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101524694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101524694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101524694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101524695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101524695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:26.419770 run patchelf(pid=27825): Terminating (SIGINT) 10:15:26.588914 run patchelf(pid=27825): Terminated: ok {rc=0} 10:15:26.711178 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27822): Process ended prematurely: osmo-stp_10.42.42.5(pid=27822) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27822)] [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:15:26.720164 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 10:15:26.746997 run osmo-hlr_10.42.42.2(pid=27819): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27819)] 10:15:26.794508 run osmo-hlr_10.42.42.2(pid=27819): stdout: | (launched: 2022-12-10_10:15:23.574491) 10:15:26.843691 run osmo-hlr_10.42.42.2(pid=27819): stderr: | 20221210101523753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101523753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101523753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101523753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101523753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101523753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101523766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101523777 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101523778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101523778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:26.893448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27818): Terminating (SIGTERM) 10:15:26.933480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27821): Terminating (SIGTERM) 10:15:26.973896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27824): Terminating (SIGTERM) 10:15:27.014095 --- ParallelTerminationStrategy: PID 27818 died... 10:15:27.033317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27818): Terminated: ok {rc=0} 10:15:27.077623 --- ParallelTerminationStrategy: PID 27821 died... 10:15:27.096315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27821): Terminated: ok {rc=0} 10:15:27.140489 --- ParallelTerminationStrategy: PID 27824 died... 10:15:27.159138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27824): Terminated: ok {rc=0} 10:15:27.246469 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:15:28.557415 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:28.564384 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:15:28.598049 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:15:28.632415 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:15:28.686435 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:15:28.720259 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:15:28.754768 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:15:29.312629 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:15:29.317574 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.328731 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:15:29.398212 tst switch_tch_pdch.py: using LAC 27690 10:15:29.515044 tst switch_tch_pdch.py: using RAC 150 10:15:29.632130 tst switch_tch_pdch.py: using CellId 27690 10:15:29.758659 tst switch_tch_pdch.py: using BVCI 27691 10:15:29.876267 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.888342 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.900202 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.913173 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.925410 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.937832 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.950162 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:15:29.962004 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:15:30.081488 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:15:30.198429 tst switch_tch_pdch.py:51: start network... 10:15:30.402048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:30.865764 run create_hlr_db(pid=27829): Launched 10:15:31.013337 bus /gobi_6: Setting Powered False 10:15:32.108524 run create_hlr_db(pid=27829): Terminated: ok {rc=0} 10:15:32.557159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Launched 10:15:32.876136 run osmo-hlr_10.42.42.2(pid=27832): Launched 10:15:32.998384 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:33.551163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Launched 10:15:33.854384 run osmo-stp_10.42.42.5(pid=27835): Launched 10:15:33.968261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:34.482369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27837): Launched 10:15:34.597121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:34.848381 run patchelf(pid=27838): Launched 10:15:35.015089 run osmo-stp_10.42.42.5(pid=27835): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] 10:15:35.142019 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-10_10:15:33.800051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:35.270413 run osmo-stp_10.42.42.5(pid=27835): stderr: | 20221210101533969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101533969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101533969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101533970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101533972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101533972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101533972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:35.399368 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-10_10:15:33.800051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:35.521684 run osmo-stp_10.42.42.5(pid=27835): stderr: | 20221210101533969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101533969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101533969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101533970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101533972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101533972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101533972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:35.666769 run patchelf(pid=27838): Terminating (SIGINT) 10:15:35.834481 run patchelf(pid=27838): Terminated: ok {rc=0} 10:15:35.956569 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27835): Process ended prematurely: osmo-stp_10.42.42.5(pid=27835) [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:15:35.965415 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:15:35.992433 run osmo-hlr_10.42.42.2(pid=27832): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27832)] 10:15:36.039963 run osmo-hlr_10.42.42.2(pid=27832): stdout: | (launched: 2022-12-10_10:15:32.818555) 10:15:36.089252 run osmo-hlr_10.42.42.2(pid=27832): stderr: | 20221210101533017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101533017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101533017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101533017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101533017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101533017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101533029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101533038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101533038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101533038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:36.138863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminating (SIGTERM) 10:15:36.179133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminating (SIGTERM) 10:15:36.219199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27837): Terminating (SIGTERM) 10:15:36.259523 --- ParallelTerminationStrategy: PID 27831 died... 10:15:36.278755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminated: ok {rc=0} 10:15:36.323191 --- ParallelTerminationStrategy: PID 27834 died... 10:15:36.342045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminated: ok {rc=0} 10:15:36.386352 --- ParallelTerminationStrategy: PID 27837 died... 10:15:36.405267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27837): Terminated: ok {rc=0} 10:15:36.489559 bus /gobi_0: Setting Powered False 10:15:37.587601 bus /gobi_0: Setting Powered False 10:15:38.707904 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:15:39.962778 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:39.968605 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:15:40.001822 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:15:40.036104 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:15:40.089359 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:15:40.121989 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:15:40.156007 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:15:40.715351 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:15:40.720932 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:40.732731 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:15:40.807560 tst switch_tch_pdch.py: using LAC 27691 10:15:40.932942 tst switch_tch_pdch.py: using RAC 151 10:15:41.055656 tst switch_tch_pdch.py: using CellId 27691 10:15:41.178561 tst switch_tch_pdch.py: using BVCI 27692 10:15:41.294894 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:41.306349 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:41.317523 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:41.328907 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:41.340355 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:41.351793 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:41.363324 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:15:41.374753 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:15:41.490890 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:15:41.606356 tst switch_tch_pdch.py:51: start network... 10:15:41.806603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:15:42.241975 run create_hlr_db(pid=27842): Launched 10:15:42.363840 bus /gobi_6: Setting Powered False 10:15:43.423129 run create_hlr_db(pid=27842): Terminated: ok {rc=0} 10:15:43.832618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27844): Launched 10:15:44.151120 run osmo-hlr_10.42.42.2(pid=27845): Launched 10:15:44.272907 run osmo-stp_10.42.42.5: Starting osmo-stp 10:15:44.795640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27847): Launched 10:15:45.113710 run osmo-stp_10.42.42.5(pid=27848): Launched 10:15:45.234975 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:15:45.757191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27850): Launched 10:15:45.898360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:15:46.185391 run patchelf(pid=27851): Launched 10:15:46.389954 run osmo-stp_10.42.42.5(pid=27848): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27848)] 10:15:46.528773 run osmo-stp_10.42.42.5(pid=27848): stdout: | (launched: 2022-12-10_10:15:45.056395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:46.694958 run osmo-stp_10.42.42.5(pid=27848): stderr: | 20221210101545248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101545248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101545249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101545249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101545250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101545250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101545250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:46.851811 run osmo-stp_10.42.42.5(pid=27848): stdout: | (launched: 2022-12-10_10:15:45.056395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:15:46.987886 run osmo-stp_10.42.42.5(pid=27848): stderr: | 20221210101545248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101545248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101545249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101545249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101545250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101545250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101545250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:15:47.162733 run patchelf(pid=27851): Terminating (SIGINT) 10:15:47.339552 run patchelf(pid=27851): Terminated: ok {rc=0} 10:15:47.469900 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27848): Process ended prematurely: osmo-stp_10.42.42.5(pid=27848) [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27848)] [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:15:47.479401 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 10:15:47.508705 run osmo-hlr_10.42.42.2(pid=27845): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27845)] 10:15:47.559280 run osmo-hlr_10.42.42.2(pid=27845): stdout: | (launched: 2022-12-10_10:15:44.093816) 10:15:47.611825 run osmo-hlr_10.42.42.2(pid=27845): stderr: | 20221210101544290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101544290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101544290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101544290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101544290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101544290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101544303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101544311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101544311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101544311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:15:47.664660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27844): Terminating (SIGTERM) 10:15:47.707228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27847): Terminating (SIGTERM) 10:15:47.749465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27850): Terminating (SIGTERM) 10:15:47.791977 --- ParallelTerminationStrategy: PID 27844 died... 10:15:47.811863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27844): Terminated: ok {rc=0} 10:15:47.859135 --- ParallelTerminationStrategy: PID 27847 died... 10:15:47.878836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27847): Terminated: ok {rc=0} 10:15:47.926111 --- ParallelTerminationStrategy: PID 27850 died... 10:15:47.945519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27850): Terminated: ok {rc=0} 10:15:48.035247 bus /gobi_0: Setting Powered False 10:15:49.133817 bus /gobi_0: Setting Powered False 10:15:50.247765 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:15:51.502791 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:51.506727 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:15:51.541060 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:15:51.547900 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:15:51.599930 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:15:51.633654 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:15:51.640446 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:15:52.178756 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:15:52.183879 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:15:52.194865 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:15:52.243924 tst mo_mt_sms.py: using LAC 27692 10:15:52.361625 tst mo_mt_sms.py: using RAC 152 10:15:52.480551 tst mo_mt_sms.py: using CellId 27692 10:15:52.598317 tst mo_mt_sms.py: using BVCI 27693 10:15:52.706188 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:15:52.823346 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:15:52.935109 tst mo_mt_sms.py:9: start nitb and bts... 10:15:53.137102 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:15:53.745426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27855): Launched 10:15:54.043889 run osmo-nitb_10.42.42.2(pid=27856): Launched 10:15:54.210288 run osmo-nitb_10.42.42.2(pid=27856): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27856)] 10:15:54.344209 run osmo-nitb_10.42.42.2(pid=27856): stdout: | (launched: 2022-12-10_10:15:53.989805) 10:15:54.479490 run osmo-nitb_10.42.42.2(pid=27856): stderr: | (launched: 2022-12-10_10:15:54.034248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:15:54.616623 run osmo-nitb_10.42.42.2(pid=27856): stdout: | (launched: 2022-12-10_10:15:53.989805) 10:15:54.778428 run osmo-nitb_10.42.42.2(pid=27856): stderr: | (launched: 2022-12-10_10:15:54.034248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27856) [trial-2373↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27856)] 10:15:55.157341 tst osmo-nitb_10.42.42.2(pid=27856): stdout: | (launched: 2022-12-10_10:15:53.989805) 10:15:55.277466 tst osmo-nitb_10.42.42.2(pid=27856): stderr: | (launched: 2022-12-10_10:15:54.034248) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:15:55.418611 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27856) [trial-2373↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27856)] [trial-2373↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 10:15:55.426868 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 10:15:55.433469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27855): Terminating (SIGTERM) 10:15:55.642342 --- ParallelTerminationStrategy: PID 27855 died... 10:15:55.663067 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27855): Terminated: ok {rc=0} 10:15:55.748461 bus /sierra_3: Setting Powered False 10:15:56.848040 bus /sierra_3: Setting Powered False 10:15:57.963740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:trx-sysmocell5000 --------------------------------------------------------------------- 10:15:59.159956 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:15:59.163775 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:15:59.197183 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:15:59.223718 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 10:15:59.274965 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:15:59.308417 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:15:59.334804 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 10:15:59.882857 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 10:15:59.887594 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:15:59.898345 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:15:59.951292 tst mo_mt_sms.py: using LAC 27693 10:16:00.067297 tst mo_mt_sms.py: using RAC 153 10:16:00.182660 tst mo_mt_sms.py: using CellId 27693 10:16:00.297904 tst mo_mt_sms.py: using BVCI 27694 10:16:00.416306 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:00.427640 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:00.438963 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:00.450905 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:00.462511 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:00.474126 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:16:00.593335 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 10:16:00.709553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:01.215398 run create_hlr_db(pid=27862): Launched 10:16:01.367737 bus /sierra_2: Setting Powered False 10:16:02.431438 run create_hlr_db(pid=27862): Terminated: ok {rc=0} 10:16:02.859973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27864): Launched 10:16:03.159171 run osmo-hlr_10.42.42.2(pid=27865): Launched 10:16:03.273803 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:03.800844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27867): Launched 10:16:04.098797 run osmo-stp_10.42.42.5(pid=27868): Launched 10:16:04.213863 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:04.750779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27870): Launched 10:16:05.047775 run osmo-msc_10.42.42.6(pid=27871): Launched 10:16:05.214288 run osmo-stp_10.42.42.5(pid=27868): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27868)] 10:16:05.340352 run osmo-stp_10.42.42.5(pid=27868): stdout: | (launched: 2022-12-10_10:16:04.044765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:05.466960 run osmo-stp_10.42.42.5(pid=27868): stderr: | 20221210101604212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101604213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101604213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101604213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101604214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101604214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101604214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:05.590479 run osmo-stp_10.42.42.5(pid=27868): stdout: | (launched: 2022-12-10_10:16:04.044765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:05.709376 run osmo-stp_10.42.42.5(pid=27868): stderr: | 20221210101604212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101604213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101604213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101604213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101604214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101604214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101604214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:05.850823 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27868): Process ended prematurely: osmo-stp_10.42.42.5(pid=27868) [trial-2373↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27868)] [trial-2373↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 10:16:05.858982 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 10:16:05.884860 run osmo-hlr_10.42.42.2(pid=27865): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27865)] 10:16:05.932612 run osmo-hlr_10.42.42.2(pid=27865): stdout: | (launched: 2022-12-10_10:16:03.104878) 10:16:05.981695 run osmo-hlr_10.42.42.2(pid=27865): stderr: | 20221210101603281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101603281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101603281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101603281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101603281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101603281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101603292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101603302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101603303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101603303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:06.050259 run osmo-msc_10.42.42.6(pid=27871): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27871)] 10:16:06.097635 run osmo-msc_10.42.42.6(pid=27871): stdout: | (launched: 2022-12-10_10:16:04.993725) 10:16:06.146611 run osmo-msc_10.42.42.6(pid=27871): stderr: | 20221210101605269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101605269 DLGLOBAL DEBUG validating counter group 0x7ffaacca4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101605269 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101605269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101605269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101605270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101605271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101605272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101605272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101605272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:06.196695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27864): Terminating (SIGTERM) 10:16:06.236064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27867): Terminating (SIGTERM) 10:16:06.275522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27870): Terminating (SIGTERM) 10:16:06.315018 --- ParallelTerminationStrategy: PID 27864 died... 10:16:06.334081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27864): Terminated: ok {rc=0} 10:16:06.378023 --- ParallelTerminationStrategy: PID 27867 died... 10:16:06.396440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27867): Terminated: ok {rc=0} 10:16:06.440136 --- ParallelTerminationStrategy: PID 27870 died... 10:16:06.458756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27870): Terminated: ok {rc=0} 10:16:06.544213 bus /sierra_3: Setting Powered False 10:16:07.644446 bus /sierra_3: Setting Powered False 10:16:08.759634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:16:09.996277 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:10.000418 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:16:10.035712 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 10:16:10.042785 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:16:10.079343 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:16:10.114325 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 10:16:10.121369 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:16:10.641057 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:16:10.646327 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 10:16:10.657800 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:16:10.707083 tst assert_extension.py: using LAC 27694 10:16:10.832910 tst assert_extension.py: using RAC 154 10:16:10.957931 tst assert_extension.py: using CellId 27694 10:16:11.083779 tst assert_extension.py: using BVCI 27695 10:16:11.199569 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:16:11.312789 tst assert_extension.py:10: start nitb and bts... 10:16:11.528495 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:16:12.178528 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27876): Launched 10:16:12.497372 run osmo-nitb_10.42.42.2(pid=27877): Launched 10:16:12.674871 run osmo-nitb_10.42.42.2(pid=27877): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27877)] 10:16:12.818144 run osmo-nitb_10.42.42.2(pid=27877): stdout: | (launched: 2022-12-10_10:16:12.440015) 10:16:12.964016 run osmo-nitb_10.42.42.2(pid=27877): stderr: | (launched: 2022-12-10_10:16:12.487215) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:16:13.109085 run osmo-nitb_10.42.42.2(pid=27877): stdout: | (launched: 2022-12-10_10:16:12.440015) 10:16:13.247969 run osmo-nitb_10.42.42.2(pid=27877): stderr: | (launched: 2022-12-10_10:16:12.487215) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27877): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27877) [trial-2373↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27877)] 10:16:13.618767 tst osmo-nitb_10.42.42.2(pid=27877): stdout: | (launched: 2022-12-10_10:16:12.440015) 10:16:13.748774 tst osmo-nitb_10.42.42.2(pid=27877): stderr: | (launched: 2022-12-10_10:16:12.487215) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:16:13.901978 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27877): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27877) [trial-2373↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27877)] [trial-2373↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 10:16:13.911024 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:16:13.918328 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27876): Terminating (SIGTERM) 10:16:14.130415 --- ParallelTerminationStrategy: PID 27876 died... 10:16:14.152480 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27876): Terminated: ok {rc=0} 10:16:14.242977 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 10:16:15.426752 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:15.431413 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:16:15.465913 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:16:15.492729 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 10:16:15.528621 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:16:15.564354 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:16:15.592434 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 10:16:16.152425 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 10:16:16.158601 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:16.172210 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:16:16.228175 tst assert_extension.py: using LAC 27695 10:16:16.357709 tst assert_extension.py: using RAC 155 10:16:16.486333 tst assert_extension.py: using CellId 27695 10:16:16.619523 tst assert_extension.py: using BVCI 27696 10:16:16.731058 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:16.742864 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:16.754451 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:16.766670 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:16.778866 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:16:16.790405 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 10:16:16.906457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:17.453408 run create_hlr_db(pid=27881): Launched 10:16:17.577183 bus /sierra_2: Setting Powered False 10:16:18.640553 run create_hlr_db(pid=27881): Terminated: ok {rc=0} 10:16:19.069638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27883): Launched 10:16:19.369739 run osmo-hlr_10.42.42.2(pid=27884): Launched 10:16:19.484475 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:20.108235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27886): Launched 10:16:20.403121 run osmo-stp_10.42.42.5(pid=27887): Launched 10:16:20.516345 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:21.049596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27889): Launched 10:16:21.344389 run osmo-msc_10.42.42.6(pid=27890): Launched 10:16:21.508077 run osmo-stp_10.42.42.5(pid=27887): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27887)] 10:16:21.633240 run osmo-stp_10.42.42.5(pid=27887): stdout: | (launched: 2022-12-10_10:16:20.349771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:21.758204 run osmo-stp_10.42.42.5(pid=27887): stderr: | 20221210101620518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101620518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101620518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101620519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101620519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101620519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101620519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:21.880746 run osmo-stp_10.42.42.5(pid=27887): stdout: | (launched: 2022-12-10_10:16:20.349771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:21.998151 run osmo-stp_10.42.42.5(pid=27887): stderr: | 20221210101620518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101620518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101620518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101620519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101620519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101620519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101620519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:22.138899 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27887): Process ended prematurely: osmo-stp_10.42.42.5(pid=27887) [trial-2373↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27887)] [trial-2373↪ussd:trx-sysmocell5000↪assert_extension.py:17] 10:16:22.147176 tst assert_extension.py:17: Test FAILED (6.0 sec) 10:16:22.173249 run osmo-hlr_10.42.42.2(pid=27884): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27884)] 10:16:22.221165 run osmo-hlr_10.42.42.2(pid=27884): stdout: | (launched: 2022-12-10_10:16:19.315071) 10:16:22.270390 run osmo-hlr_10.42.42.2(pid=27884): stderr: | 20221210101619490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101619490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101619490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101619490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101619490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101619490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101619503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101619514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101619514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101619514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:22.339374 run osmo-msc_10.42.42.6(pid=27890): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27890)] 10:16:22.386931 run osmo-msc_10.42.42.6(pid=27890): stdout: | (launched: 2022-12-10_10:16:21.290276) 10:16:22.435854 run osmo-msc_10.42.42.6(pid=27890): stderr: | 20221210101621562 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101621562 DLGLOBAL DEBUG validating counter group 0x7f6f8205fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101621562 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101621563 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101621563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101621563 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101621565 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101621565 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101621565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101621565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:22.485347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27883): Terminating (SIGTERM) 10:16:22.525249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27886): Terminating (SIGTERM) 10:16:22.565367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27889): Terminating (SIGTERM) 10:16:22.605485 --- ParallelTerminationStrategy: PID 27883 died... 10:16:22.624563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27883): Terminated: ok {rc=0} 10:16:22.668668 --- ParallelTerminationStrategy: PID 27886 died... 10:16:22.687237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27886): Terminated: ok {rc=0} 10:16:22.730957 --- ParallelTerminationStrategy: PID 27889 died... 10:16:22.749416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27889): Terminated: ok {rc=0} 10:16:22.833401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:16:24.049042 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:24.056624 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:16:24.092539 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:16:24.120175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:16:24.172570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:16:24.207321 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:16:24.234722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:16:24.786829 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:16:24.836003 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:24.847390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:16:24.917706 tst mo_mt_call.py: using LAC 27696 10:16:25.037799 tst mo_mt_call.py: using RAC 156 10:16:25.155338 tst mo_mt_call.py: using CellId 27696 10:16:25.274493 tst mo_mt_call.py: using BVCI 27697 10:16:25.384327 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:25.395729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:25.406989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:25.418530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:25.430078 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:25.441544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:16:25.560076 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:16:25.674866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:26.139823 run create_hlr_db(pid=27895): Launched 10:16:26.263183 bus /sierra_2: Setting Powered False 10:16:27.322623 run create_hlr_db(pid=27895): Terminated: ok {rc=0} 10:16:27.759224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27897): Launched 10:16:28.079228 run osmo-hlr_10.42.42.2(pid=27898): Launched 10:16:28.202733 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:28.756302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27900): Launched 10:16:29.076776 run osmo-stp_10.42.42.5(pid=27901): Launched 10:16:29.198988 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:29.777785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27903): Launched 10:16:30.099563 run osmo-msc_10.42.42.6(pid=27904): Launched 10:16:30.278547 run osmo-stp_10.42.42.5(pid=27901): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27901)] 10:16:30.414280 run osmo-stp_10.42.42.5(pid=27901): stdout: | (launched: 2022-12-10_10:16:29.019090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:30.550502 run osmo-stp_10.42.42.5(pid=27901): stderr: | 20221210101629212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101629212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101629212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101629213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101629213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101629213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101629213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:30.685511 run osmo-stp_10.42.42.5(pid=27901): stdout: | (launched: 2022-12-10_10:16:29.019090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:30.813289 run osmo-stp_10.42.42.5(pid=27901): stderr: | 20221210101629212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101629212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101629212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101629213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101629213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101629213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101629213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:30.974591 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27901): Process ended prematurely: osmo-stp_10.42.42.5(pid=27901) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27901)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:16:30.984638 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:16:31.013739 run osmo-hlr_10.42.42.2(pid=27898): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27898)] 10:16:31.065328 run osmo-hlr_10.42.42.2(pid=27898): stdout: | (launched: 2022-12-10_10:16:28.021593) 10:16:31.118114 run osmo-hlr_10.42.42.2(pid=27898): stderr: | 20221210101628218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101628218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101628218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101628218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101628218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101628218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101628230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101628238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101628238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101628238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:31.191924 run osmo-msc_10.42.42.6(pid=27904): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27904)] 10:16:31.243095 run osmo-msc_10.42.42.6(pid=27904): stdout: | (launched: 2022-12-10_10:16:30.041876) 10:16:31.295994 run osmo-msc_10.42.42.6(pid=27904): stderr: | 20221210101630362 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101630362 DLGLOBAL DEBUG validating counter group 0x7fb21e1e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101630362 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101630362 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101630363 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101630363 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101630364 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101630365 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101630365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101630365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:31.349448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27897): Terminating (SIGTERM) 10:16:31.392283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27900): Terminating (SIGTERM) 10:16:31.435095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27903): Terminating (SIGTERM) 10:16:31.478243 --- ParallelTerminationStrategy: PID 27897 died... 10:16:31.498215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27897): Terminated: ok {rc=0} 10:16:31.545464 --- ParallelTerminationStrategy: PID 27900 died... 10:16:31.565356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27900): Terminated: ok {rc=0} 10:16:31.612544 --- ParallelTerminationStrategy: PID 27903 died... 10:16:31.632526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27903): Terminated: ok {rc=0} 10:16:31.721772 bus /sierra_3: Setting Powered False 10:16:32.820528 bus /sierra_3: Setting Powered False 10:16:33.939939 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:16:35.087273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:35.099281 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:16:35.178974 tst mo_mt_call_osmux.py: using LAC 27697 10:16:35.310271 tst mo_mt_call_osmux.py: using RAC 157 10:16:35.429093 tst mo_mt_call_osmux.py: using CellId 27697 10:16:35.549012 tst mo_mt_call_osmux.py: using BVCI 27698 10:16:35.659871 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:35.671253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:35.682712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:35.694383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:35.705602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:16:35.716625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:16:35.832007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:16:35.953173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:36.452573 run create_hlr_db(pid=27906): Launched 10:16:36.575441 bus /sierra_2: Setting Powered False 10:16:37.639839 run create_hlr_db(pid=27906): Terminated: ok {rc=0} 10:16:38.070623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27908): Launched 10:16:38.371549 run osmo-hlr_10.42.42.2(pid=27909): Launched 10:16:38.488026 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:39.022783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27911): Launched 10:16:39.322728 run osmo-stp_10.42.42.5(pid=27912): Launched 10:16:39.438315 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:39.982912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27914): Launched 10:16:40.283986 run osmo-msc_10.42.42.6(pid=27915): Launched 10:16:40.452791 run osmo-stp_10.42.42.5(pid=27912): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27912)] 10:16:40.581202 run osmo-stp_10.42.42.5(pid=27912): stdout: | (launched: 2022-12-10_10:16:39.268391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:40.708232 run osmo-stp_10.42.42.5(pid=27912): stderr: | 20221210101639440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101639440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101639440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101639440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101639441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101639441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101639441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:40.833780 run osmo-stp_10.42.42.5(pid=27912): stdout: | (launched: 2022-12-10_10:16:39.268391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:40.953446 run osmo-stp_10.42.42.5(pid=27912): stderr: | 20221210101639440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101639440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101639440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101639440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101639441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101639441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101639441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:41.096443 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27912): Process ended prematurely: osmo-stp_10.42.42.5(pid=27912) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27912)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:16:41.105348 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:16:41.131480 run osmo-hlr_10.42.42.2(pid=27909): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27909)] 10:16:41.179021 run osmo-hlr_10.42.42.2(pid=27909): stdout: | (launched: 2022-12-10_10:16:38.317099) 10:16:41.228172 run osmo-hlr_10.42.42.2(pid=27909): stderr: | 20221210101638494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101638494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101638494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101638494 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101638494 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101638494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101638506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101638517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101638517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101638517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:41.296790 run osmo-msc_10.42.42.6(pid=27915): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27915)] 10:16:41.344250 run osmo-msc_10.42.42.6(pid=27915): stdout: | (launched: 2022-12-10_10:16:40.229224) 10:16:41.393204 run osmo-msc_10.42.42.6(pid=27915): stderr: | 20221210101640502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101640502 DLGLOBAL DEBUG validating counter group 0x7fc5f44a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101640502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101640502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101640502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101640503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101640505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101640506 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101640506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101640506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:41.442489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27908): Terminating (SIGTERM) 10:16:41.481827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27911): Terminating (SIGTERM) 10:16:41.521470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27914): Terminating (SIGTERM) 10:16:41.561670 --- ParallelTerminationStrategy: PID 27908 died... 10:16:41.580605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27908): Terminated: ok {rc=0} 10:16:41.624838 --- ParallelTerminationStrategy: PID 27911 died... 10:16:41.643464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27911): Terminated: ok {rc=0} 10:16:41.687625 --- ParallelTerminationStrategy: PID 27914 died... 10:16:41.706282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27914): Terminated: ok {rc=0} 10:16:41.791639 bus /sierra_3: Setting Powered False 10:16:42.892080 bus /sierra_3: Setting Powered False 10:16:44.007931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:16:45.264238 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:16:45.271347 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:16:45.306871 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:16:45.334686 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:16:45.387687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:16:45.422572 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:16:45.450540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:16:46.007562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:16:46.064554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:46.077464 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:16:46.154445 tst mo_mt_call.py: using LAC 27698 10:16:46.282862 tst mo_mt_call.py: using RAC 158 10:16:46.410817 tst mo_mt_call.py: using CellId 27698 10:16:46.541397 tst mo_mt_call.py: using BVCI 27699 10:16:46.685977 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:46.702342 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:46.715303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:46.731779 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:46.749161 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:46.766811 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:46.898002 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:47.038954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:47.515415 run create_hlr_db(pid=27920): Launched 10:16:47.639243 bus /sierra_2: Setting Powered False 10:16:48.702659 run create_hlr_db(pid=27920): Terminated: ok {rc=0} 10:16:49.131715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27922): Launched 10:16:49.433774 run osmo-hlr_10.42.42.2(pid=27923): Launched 10:16:49.548919 run osmo-stp_10.42.42.5: Starting osmo-stp 10:16:50.067273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27925): Launched 10:16:50.368857 run osmo-stp_10.42.42.5(pid=27926): Launched 10:16:50.483863 run osmo-msc_10.42.42.6: Starting osmo-msc 10:16:51.034160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27928): Launched 10:16:51.335238 run osmo-msc_10.42.42.6(pid=27929): Launched 10:16:51.505831 run osmo-stp_10.42.42.5(pid=27926): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27926)] 10:16:51.633731 run osmo-stp_10.42.42.5(pid=27926): stdout: | (launched: 2022-12-10_10:16:50.313958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:51.761436 run osmo-stp_10.42.42.5(pid=27926): stderr: | 20221210101650484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101650484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101650484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101650485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101650485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101650485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101650485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:51.887366 run osmo-stp_10.42.42.5(pid=27926): stdout: | (launched: 2022-12-10_10:16:50.313958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:16:52.007050 run osmo-stp_10.42.42.5(pid=27926): stderr: | 20221210101650484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101650484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101650484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101650485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101650485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101650485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101650485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:16:52.150609 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27926): Process ended prematurely: osmo-stp_10.42.42.5(pid=27926) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27926)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:16:52.159533 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:16:52.185954 run osmo-hlr_10.42.42.2(pid=27923): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27923)] 10:16:52.233472 run osmo-hlr_10.42.42.2(pid=27923): stdout: | (launched: 2022-12-10_10:16:49.379069) 10:16:52.282711 run osmo-hlr_10.42.42.2(pid=27923): stderr: | 20221210101649555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101649555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101649555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101649555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101649555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101649556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101649568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101649577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101649577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101649577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:16:52.351246 run osmo-msc_10.42.42.6(pid=27929): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27929)] 10:16:52.398807 run osmo-msc_10.42.42.6(pid=27929): stdout: | (launched: 2022-12-10_10:16:51.280540) 10:16:52.447764 run osmo-msc_10.42.42.6(pid=27929): stderr: | 20221210101651551 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101651551 DLGLOBAL DEBUG validating counter group 0x7feefb8a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101651551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101651551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101651551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101651552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101651556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101651556 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101651556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101651557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:16:52.497081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27922): Terminating (SIGTERM) 10:16:52.537082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27925): Terminating (SIGTERM) 10:16:52.576420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27928): Terminating (SIGTERM) 10:16:52.615962 --- ParallelTerminationStrategy: PID 27922 died... 10:16:52.634879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27922): Terminated: ok {rc=0} 10:16:52.678639 --- ParallelTerminationStrategy: PID 27925 died... 10:16:52.697094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27925): Terminated: ok {rc=0} 10:16:52.740465 --- ParallelTerminationStrategy: PID 27928 died... 10:16:52.758926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27928): Terminated: ok {rc=0} 10:16:52.844177 bus /sierra_3: Setting Powered False 10:16:53.943695 bus /sierra_3: Setting Powered False 10:16:55.058615 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:16:56.209253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:56.221716 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:16:56.294434 tst mo_mt_call_osmux.py: using LAC 27699 10:16:56.425381 tst mo_mt_call_osmux.py: using RAC 159 10:16:56.550696 tst mo_mt_call_osmux.py: using CellId 27699 10:16:56.678204 tst mo_mt_call_osmux.py: using BVCI 27700 10:16:56.795302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:56.807267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:56.818729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:56.830584 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:56.842672 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:16:56.854767 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:56.971839 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:16:57.087392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:16:57.553693 run create_hlr_db(pid=27931): Launched 10:16:57.677933 bus /sierra_2: Setting Powered False 10:16:58.737539 run create_hlr_db(pid=27931): Terminated: ok {rc=0} 10:16:59.176500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27933): Launched 10:16:59.497731 run osmo-hlr_10.42.42.2(pid=27934): Launched 10:16:59.620352 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:00.177307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27936): Launched 10:17:00.498624 run osmo-stp_10.42.42.5(pid=27937): Launched 10:17:00.621100 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:01.235571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27939): Launched 10:17:01.574040 run osmo-msc_10.42.42.6(pid=27940): Launched 10:17:01.969243 run osmo-stp_10.42.42.5(pid=27937): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27937)] 10:17:02.109642 run osmo-stp_10.42.42.5(pid=27937): stdout: | (launched: 2022-12-10_10:17:00.440770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:02.283721 run osmo-stp_10.42.42.5(pid=27937): stderr: | 20221210101700634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101700635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101700635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101700635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101700636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101700636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101700636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:02.463769 run osmo-stp_10.42.42.5(pid=27937): stdout: | (launched: 2022-12-10_10:17:00.440770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:02.592213 run osmo-stp_10.42.42.5(pid=27937): stderr: | 20221210101700634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101700635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101700635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101700635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101700636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101700636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101700636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:02.746613 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27937): Process ended prematurely: osmo-stp_10.42.42.5(pid=27937) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27937)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:17:02.756388 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:17:02.784809 run osmo-hlr_10.42.42.2(pid=27934): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27934)] 10:17:02.835745 run osmo-hlr_10.42.42.2(pid=27934): stdout: | (launched: 2022-12-10_10:16:59.440104) 10:17:02.888284 run osmo-hlr_10.42.42.2(pid=27934): stderr: | 20221210101659637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101659637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101659637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101659637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101659637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101659637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101659649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101659658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101659658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101659658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:02.961743 run osmo-msc_10.42.42.6(pid=27940): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27940)] 10:17:03.012391 run osmo-msc_10.42.42.6(pid=27940): stdout: | (launched: 2022-12-10_10:17:01.509986) 10:17:03.064664 run osmo-msc_10.42.42.6(pid=27940): stderr: | 20221210101701900 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101701900 DLGLOBAL DEBUG validating counter group 0x7ff1a1ae1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101701900 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101701900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101701900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101701904 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101701906 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101701907 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101701907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101701907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:03.117595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27933): Terminating (SIGTERM) 10:17:03.159495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27936): Terminating (SIGTERM) 10:17:03.202136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27939): Terminating (SIGTERM) 10:17:03.244662 --- ParallelTerminationStrategy: PID 27933 died... 10:17:03.264768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27933): Terminated: ok {rc=0} 10:17:03.311870 --- ParallelTerminationStrategy: PID 27936 died... 10:17:03.331512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27936): Terminated: ok {rc=0} 10:17:03.378374 --- ParallelTerminationStrategy: PID 27939 died... 10:17:03.397863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27939): Terminated: ok {rc=0} 10:17:03.486940 bus /sierra_3: Setting Powered False 10:17:04.586593 bus /sierra_3: Setting Powered False 10:17:05.702501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:17:06.957679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:06.964754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:17:07.000367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:17:07.027775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:17:07.081123 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:17:07.115910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:17:07.143101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:17:07.696564 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:17:07.748670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:07.760573 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:17:07.832694 tst mo_mt_call.py: using LAC 27700 10:17:07.961382 tst mo_mt_call.py: using RAC 160 10:17:08.088924 tst mo_mt_call.py: using CellId 27700 10:17:08.208653 tst mo_mt_call.py: using BVCI 27701 10:17:08.320061 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:08.331337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:08.342611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:08.354032 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:08.365323 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:08.376588 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:17:08.496319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:17:08.611751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:09.078830 run create_hlr_db(pid=27948): Launched 10:17:09.203283 bus /sierra_2: Setting Powered False 10:17:10.263387 run create_hlr_db(pid=27948): Terminated: ok {rc=0} 10:17:10.703121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27950): Launched 10:17:11.025057 run osmo-hlr_10.42.42.2(pid=27951): Launched 10:17:11.149129 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:11.708425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27953): Launched 10:17:12.029102 run osmo-stp_10.42.42.5(pid=27954): Launched 10:17:12.152133 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:12.734227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27956): Launched 10:17:13.057335 run osmo-msc_10.42.42.6(pid=27957): Launched 10:17:13.237813 run osmo-stp_10.42.42.5(pid=27954): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27954)] 10:17:13.373675 run osmo-stp_10.42.42.5(pid=27954): stdout: | (launched: 2022-12-10_10:17:11.971729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:13.510785 run osmo-stp_10.42.42.5(pid=27954): stderr: | 20221210101712163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101712163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101712163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101712163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101712166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101712166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101712166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:13.646962 run osmo-stp_10.42.42.5(pid=27954): stdout: | (launched: 2022-12-10_10:17:11.971729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:13.775188 run osmo-stp_10.42.42.5(pid=27954): stderr: | 20221210101712163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101712163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101712163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101712163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101712166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101712166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101712166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:13.928822 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27954): Process ended prematurely: osmo-stp_10.42.42.5(pid=27954) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27954)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:17:13.938677 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:17:13.967419 run osmo-hlr_10.42.42.2(pid=27951): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27951)] 10:17:14.017726 run osmo-hlr_10.42.42.2(pid=27951): stdout: | (launched: 2022-12-10_10:17:10.967256) 10:17:14.069615 run osmo-hlr_10.42.42.2(pid=27951): stderr: | 20221210101711166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101711166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101711167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101711167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101711167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101711167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101711179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101711187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101711187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101711187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:14.142027 run osmo-msc_10.42.42.6(pid=27957): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27957)] 10:17:14.191944 run osmo-msc_10.42.42.6(pid=27957): stdout: | (launched: 2022-12-10_10:17:12.999651) 10:17:14.243759 run osmo-msc_10.42.42.6(pid=27957): stderr: | 20221210101713322 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101713322 DLGLOBAL DEBUG validating counter group 0x7f1df87c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101713322 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101713322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101713322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101713322 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101713324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101713324 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101713324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101713324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:14.295822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27950): Terminating (SIGTERM) 10:17:14.337906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27953): Terminating (SIGTERM) 10:17:14.380130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27956): Terminating (SIGTERM) 10:17:14.422622 --- ParallelTerminationStrategy: PID 27950 died... 10:17:14.442578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27950): Terminated: ok {rc=0} 10:17:14.489112 --- ParallelTerminationStrategy: PID 27953 died... 10:17:14.508495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27953): Terminated: ok {rc=0} 10:17:14.554494 --- ParallelTerminationStrategy: PID 27956 died... 10:17:14.573879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27956): Terminated: ok {rc=0} 10:17:14.660878 bus /sierra_3: Setting Powered False 10:17:15.757270 bus /sierra_3: Setting Powered False 10:17:16.868001 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:17:18.013749 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:18.025672 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:17:18.096172 tst mo_mt_call_osmux.py: using LAC 27701 10:17:18.215270 tst mo_mt_call_osmux.py: using RAC 161 10:17:18.336194 tst mo_mt_call_osmux.py: using CellId 27701 10:17:18.457122 tst mo_mt_call_osmux.py: using BVCI 27702 10:17:18.566617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:18.578190 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:18.589548 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:18.601170 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:18.612781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:17:18.624278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:17:18.743672 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:17:18.862559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:19.330749 run create_hlr_db(pid=27959): Launched 10:17:19.453600 bus /sierra_2: Setting Powered False 10:17:20.513513 run create_hlr_db(pid=27959): Terminated: ok {rc=0} 10:17:20.953329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27961): Launched 10:17:21.276145 run osmo-hlr_10.42.42.2(pid=27962): Launched 10:17:21.399869 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:21.960532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27964): Launched 10:17:22.282724 run osmo-stp_10.42.42.5(pid=27965): Launched 10:17:22.406066 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:22.991641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27967): Launched 10:17:23.313096 run osmo-msc_10.42.42.6(pid=27968): Launched 10:17:23.493376 run osmo-stp_10.42.42.5(pid=27965): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27965)] 10:17:23.631589 run osmo-stp_10.42.42.5(pid=27965): stdout: | (launched: 2022-12-10_10:17:22.224842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:23.770283 run osmo-stp_10.42.42.5(pid=27965): stderr: | 20221210101722416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101722416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101722416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101722416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101722417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101722417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101722417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:23.906382 run osmo-stp_10.42.42.5(pid=27965): stdout: | (launched: 2022-12-10_10:17:22.224842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:24.035489 run osmo-stp_10.42.42.5(pid=27965): stderr: | 20221210101722416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101722416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101722416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101722416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101722417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101722417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101722417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:24.189391 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27965): Process ended prematurely: osmo-stp_10.42.42.5(pid=27965) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27965)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:17:24.199127 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:17:24.227742 run osmo-hlr_10.42.42.2(pid=27962): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27962)] 10:17:24.278290 run osmo-hlr_10.42.42.2(pid=27962): stdout: | (launched: 2022-12-10_10:17:21.218236) 10:17:24.330555 run osmo-hlr_10.42.42.2(pid=27962): stderr: | 20221210101721416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101721416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101721416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101721416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101721416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101721416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101721428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101721436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101721436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101721437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:24.403492 run osmo-msc_10.42.42.6(pid=27968): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27968)] 10:17:24.453707 run osmo-msc_10.42.42.6(pid=27968): stdout: | (launched: 2022-12-10_10:17:23.255285) 10:17:24.505575 run osmo-msc_10.42.42.6(pid=27968): stderr: | 20221210101723573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101723573 DLGLOBAL DEBUG validating counter group 0x7fc323c0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101723573 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101723573 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101723574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101723574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101723575 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101723576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101723576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101723576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:24.557992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27961): Terminating (SIGTERM) 10:17:24.600234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27964): Terminating (SIGTERM) 10:17:24.642388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27967): Terminating (SIGTERM) 10:17:24.684642 --- ParallelTerminationStrategy: PID 27961 died... 10:17:24.704506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27961): Terminated: ok {rc=0} 10:17:24.751229 --- ParallelTerminationStrategy: PID 27964 died... 10:17:24.770726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27964): Terminated: ok {rc=0} 10:17:24.817578 --- ParallelTerminationStrategy: PID 27967 died... 10:17:24.837119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27967): Terminated: ok {rc=0} 10:17:24.925734 bus /sierra_3: Setting Powered False 10:17:26.021137 bus /sierra_3: Setting Powered False 10:17:27.135671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:17:28.394975 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:28.402252 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:17:28.438287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:17:28.466113 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:17:28.519936 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:17:28.553698 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:17:28.580418 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:17:29.139571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:17:29.192226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:29.204014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:17:29.276141 tst mo_mt_call.py: using LAC 27702 10:17:29.404124 tst mo_mt_call.py: using RAC 162 10:17:29.530395 tst mo_mt_call.py: using CellId 27702 10:17:29.656530 tst mo_mt_call.py: using BVCI 27703 10:17:29.768226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:29.779339 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:29.790319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:29.801889 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:29.813486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:29.824891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:17:29.946773 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:17:30.063167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:30.531273 run create_hlr_db(pid=27973): Launched 10:17:30.654800 bus /sierra_2: Setting Powered False 10:17:31.722793 run create_hlr_db(pid=27973): Terminated: ok {rc=0} 10:17:32.196398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27975): Launched 10:17:32.531100 run osmo-hlr_10.42.42.2(pid=27976): Launched 10:17:32.655065 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:33.215324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27978): Launched 10:17:33.536358 run osmo-stp_10.42.42.5(pid=27979): Launched 10:17:33.659359 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:34.242553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27981): Launched 10:17:34.565186 run osmo-msc_10.42.42.6(pid=27982): Launched 10:17:34.745231 run osmo-stp_10.42.42.5(pid=27979): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27979)] 10:17:34.882053 run osmo-stp_10.42.42.5(pid=27979): stdout: | (launched: 2022-12-10_10:17:33.478538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:35.019796 run osmo-stp_10.42.42.5(pid=27979): stderr: | 20221210101733671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101733671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101733672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101733672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101733673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101733673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101733673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:35.156379 run osmo-stp_10.42.42.5(pid=27979): stdout: | (launched: 2022-12-10_10:17:33.478538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:35.284732 run osmo-stp_10.42.42.5(pid=27979): stderr: | 20221210101733671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101733671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101733672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101733672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101733673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101733673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101733673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:35.439002 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27979): Process ended prematurely: osmo-stp_10.42.42.5(pid=27979) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27979)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:17:35.448572 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:17:35.477263 run osmo-hlr_10.42.42.2(pid=27976): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27976)] 10:17:35.527852 run osmo-hlr_10.42.42.2(pid=27976): stdout: | (launched: 2022-12-10_10:17:32.473473) 10:17:35.579804 run osmo-hlr_10.42.42.2(pid=27976): stderr: | 20221210101732672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101732672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101732672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101732672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101732672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101732672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101732687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101732696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101732697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101732697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:35.652374 run osmo-msc_10.42.42.6(pid=27982): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27982)] 10:17:35.702813 run osmo-msc_10.42.42.6(pid=27982): stdout: | (launched: 2022-12-10_10:17:34.507158) 10:17:35.754911 run osmo-msc_10.42.42.6(pid=27982): stderr: | 20221210101734826 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101734827 DLGLOBAL DEBUG validating counter group 0x7ff5ecc35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101734827 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101734827 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101734827 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101734827 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101734829 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101734829 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101734830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101734830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:35.807597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27975): Terminating (SIGTERM) 10:17:35.849951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27978): Terminating (SIGTERM) 10:17:35.892359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27981): Terminating (SIGTERM) 10:17:35.937334 --- ParallelTerminationStrategy: PID 27975 died... 10:17:35.956013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27975): Terminated: ok {rc=0} 10:17:36.005760 --- ParallelTerminationStrategy: PID 27978 died... 10:17:36.025163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27978): Terminated: ok {rc=0} 10:17:36.072423 --- ParallelTerminationStrategy: PID 27981 died... 10:17:36.091880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27981): Terminated: ok {rc=0} 10:17:36.181347 bus /sierra_3: Setting Powered False 10:17:37.279432 bus /sierra_3: Setting Powered False 10:17:38.396861 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:17:39.545557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:39.557775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:17:39.634800 tst mo_mt_call_osmux.py: using LAC 27703 10:17:39.764610 tst mo_mt_call_osmux.py: using RAC 163 10:17:39.888495 tst mo_mt_call_osmux.py: using CellId 27703 10:17:40.013447 tst mo_mt_call_osmux.py: using BVCI 27704 10:17:40.131856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:40.143665 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:40.155270 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:40.167197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:40.179082 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:17:40.190786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:17:40.307422 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:17:40.428754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:40.926073 run create_hlr_db(pid=27986): Launched 10:17:41.049142 bus /sierra_2: Setting Powered False 10:17:42.113502 run create_hlr_db(pid=27986): Terminated: ok {rc=0} 10:17:42.544697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27988): Launched 10:17:42.846318 run osmo-hlr_10.42.42.2(pid=27989): Launched 10:17:42.962716 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:43.498035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27991): Launched 10:17:43.798609 run osmo-stp_10.42.42.5(pid=27992): Launched 10:17:43.913292 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:44.459134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27994): Launched 10:17:44.760074 run osmo-msc_10.42.42.6(pid=27995): Launched 10:17:44.928522 run osmo-stp_10.42.42.5(pid=27992): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27992)] 10:17:45.056858 run osmo-stp_10.42.42.5(pid=27992): stdout: | (launched: 2022-12-10_10:17:43.744276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:45.184407 run osmo-stp_10.42.42.5(pid=27992): stderr: | 20221210101743915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101743916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101743916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101743916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101743917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101743917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101743917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:45.309731 run osmo-stp_10.42.42.5(pid=27992): stdout: | (launched: 2022-12-10_10:17:43.744276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:45.429239 run osmo-stp_10.42.42.5(pid=27992): stderr: | 20221210101743915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101743916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101743916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101743916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101743917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101743917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101743917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:45.572378 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27992): Process ended prematurely: osmo-stp_10.42.42.5(pid=27992) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27992)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:17:45.581246 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:17:45.607516 run osmo-hlr_10.42.42.2(pid=27989): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27989)] 10:17:45.655117 run osmo-hlr_10.42.42.2(pid=27989): stdout: | (launched: 2022-12-10_10:17:42.791909) 10:17:45.704430 run osmo-hlr_10.42.42.2(pid=27989): stderr: | 20221210101742968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101742968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101742969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101742969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101742969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101742969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101742981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101742990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101742990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101742990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:45.772891 run osmo-msc_10.42.42.6(pid=27995): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27995)] 10:17:45.820495 run osmo-msc_10.42.42.6(pid=27995): stdout: | (launched: 2022-12-10_10:17:44.705437) 10:17:45.906162 run osmo-msc_10.42.42.6(pid=27995): stderr: | 20221210101744979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101744980 DLGLOBAL DEBUG validating counter group 0x7fdbf852cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101744980 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101744980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101744980 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101744980 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101744982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101744982 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101744982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101744983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:45.962583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27988): Terminating (SIGTERM) 10:17:46.007304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27991): Terminating (SIGTERM) 10:17:46.054088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27994): Terminating (SIGTERM) 10:17:46.100277 --- ParallelTerminationStrategy: PID 27988 died... 10:17:46.122150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27988): Terminated: ok {rc=0} 10:17:46.173506 --- ParallelTerminationStrategy: PID 27991 died... 10:17:46.194114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27991): Terminated: ok {rc=0} 10:17:46.243843 --- ParallelTerminationStrategy: PID 27994 died... 10:17:46.264278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27994): Terminated: ok {rc=0} 10:17:46.363568 bus /sierra_3: Setting Powered False 10:17:47.474564 bus /sierra_3: Setting Powered False 10:17:48.589720 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:17:49.837532 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:17:49.843636 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:17:49.877249 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:17:49.903625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:17:49.955192 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:17:49.989198 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:17:50.015565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:17:50.567967 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:17:50.616219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:50.627454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:17:50.697942 tst mo_mt_call.py: using LAC 27704 10:17:50.817294 tst mo_mt_call.py: using RAC 164 10:17:50.936003 tst mo_mt_call.py: using CellId 27704 10:17:51.056139 tst mo_mt_call.py: using BVCI 27705 10:17:51.165587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:51.176649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:51.187722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:51.198812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:51.209864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:17:51.220785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:17:51.340377 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:17:51.455920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:17:51.922575 run create_hlr_db(pid=28001): Launched 10:17:52.046062 bus /sierra_2: Setting Powered False 10:17:53.110180 run create_hlr_db(pid=28001): Terminated: ok {rc=0} 10:17:53.542967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28003): Launched 10:17:53.845715 run osmo-hlr_10.42.42.2(pid=28004): Launched 10:17:53.960863 run osmo-stp_10.42.42.5: Starting osmo-stp 10:17:54.479150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28006): Launched 10:17:54.780164 run osmo-stp_10.42.42.5(pid=28007): Launched 10:17:54.895558 run osmo-msc_10.42.42.6: Starting osmo-msc 10:17:55.443281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28009): Launched 10:17:55.746146 run osmo-msc_10.42.42.6(pid=28010): Launched 10:17:55.915852 run osmo-stp_10.42.42.5(pid=28007): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28007)] 10:17:56.043675 run osmo-stp_10.42.42.5(pid=28007): stdout: | (launched: 2022-12-10_10:17:54.725466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:56.170992 run osmo-stp_10.42.42.5(pid=28007): stderr: | 20221210101754896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101754896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101754897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101754897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101754898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101754898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101754898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:56.296834 run osmo-stp_10.42.42.5(pid=28007): stdout: | (launched: 2022-12-10_10:17:54.725466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:17:56.416548 run osmo-stp_10.42.42.5(pid=28007): stderr: | 20221210101754896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101754896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101754897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101754897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101754898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101754898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101754898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:17:56.560110 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28007): Process ended prematurely: osmo-stp_10.42.42.5(pid=28007) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28007)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:17:56.568789 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:17:56.594986 run osmo-hlr_10.42.42.2(pid=28004): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28004)] 10:17:56.642361 run osmo-hlr_10.42.42.2(pid=28004): stdout: | (launched: 2022-12-10_10:17:53.791218) 10:17:56.691468 run osmo-hlr_10.42.42.2(pid=28004): stderr: | 20221210101753966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101753966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101753967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101753967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101753967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101753967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101753977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101753986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101753986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101753986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:17:56.760123 run osmo-msc_10.42.42.6(pid=28010): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28010)] 10:17:56.807410 run osmo-msc_10.42.42.6(pid=28010): stdout: | (launched: 2022-12-10_10:17:55.690994) 10:17:56.856327 run osmo-msc_10.42.42.6(pid=28010): stderr: | 20221210101755962 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101755962 DLGLOBAL DEBUG validating counter group 0x7f7cac93fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101755962 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101755962 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101755962 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101755963 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101755965 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101755966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101755966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101755966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:17:56.905716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28003): Terminating (SIGTERM) 10:17:56.945200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28006): Terminating (SIGTERM) 10:17:56.984710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28009): Terminating (SIGTERM) 10:17:57.024415 --- ParallelTerminationStrategy: PID 28003 died... 10:17:57.043737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28003): Terminated: ok {rc=0} 10:17:57.087608 --- ParallelTerminationStrategy: PID 28006 died... 10:17:57.106128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28006): Terminated: ok {rc=0} 10:17:57.149587 --- ParallelTerminationStrategy: PID 28009 died... 10:17:57.167976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28009): Terminated: ok {rc=0} 10:17:57.251566 bus /sierra_3: Setting Powered False 10:17:58.349776 bus /sierra_3: Setting Powered False 10:17:59.466759 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:18:00.615888 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:18:00.628521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:18:00.701624 tst mo_mt_call_osmux.py: using LAC 27705 10:18:00.829181 tst mo_mt_call_osmux.py: using RAC 165 10:18:00.990624 tst mo_mt_call_osmux.py: using CellId 27705 10:18:01.119826 tst mo_mt_call_osmux.py: using BVCI 27706 10:18:01.239428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:18:01.252540 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:18:01.266412 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:18:01.279133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:18:01.293705 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:18:01.307531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:18:01.435600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:18:01.565367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:02.072684 run create_hlr_db(pid=28012): Launched 10:18:02.231000 bus /sierra_2: Setting Powered False 10:18:03.294460 run create_hlr_db(pid=28012): Terminated: ok {rc=0} 10:18:03.725630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Launched 10:18:04.028550 run osmo-hlr_10.42.42.2(pid=28015): Launched 10:18:04.143193 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:04.675747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Launched 10:18:04.977724 run osmo-stp_10.42.42.5(pid=28018): Launched 10:18:05.093761 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:05.643402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28020): Launched 10:18:05.945562 run osmo-msc_10.42.42.6(pid=28021): Launched 10:18:06.115401 run osmo-stp_10.42.42.5(pid=28018): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] 10:18:06.243516 run osmo-stp_10.42.42.5(pid=28018): stdout: | (launched: 2022-12-10_10:18:04.922830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:06.371789 run osmo-stp_10.42.42.5(pid=28018): stderr: | 20221210101805091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101805091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101805091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101805091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101805092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101805092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101805092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:06.498246 run osmo-stp_10.42.42.5(pid=28018): stdout: | (launched: 2022-12-10_10:18:04.922830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:06.618187 run osmo-stp_10.42.42.5(pid=28018): stderr: | 20221210101805091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101805091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101805091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101805091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101805092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101805092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101805092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:06.762413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28018): Process ended prematurely: osmo-stp_10.42.42.5(pid=28018) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:18:06.771249 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:18:06.797463 run osmo-hlr_10.42.42.2(pid=28015): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28015)] 10:18:06.844909 run osmo-hlr_10.42.42.2(pid=28015): stdout: | (launched: 2022-12-10_10:18:03.973320) 10:18:06.894080 run osmo-hlr_10.42.42.2(pid=28015): stderr: | 20221210101804149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101804149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101804149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101804150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101804150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101804150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101804161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101804170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101804170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101804170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:06.962612 run osmo-msc_10.42.42.6(pid=28021): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28021)] 10:18:07.009870 run osmo-msc_10.42.42.6(pid=28021): stdout: | (launched: 2022-12-10_10:18:05.890610) 10:18:07.058653 run osmo-msc_10.42.42.6(pid=28021): stderr: | 20221210101806160 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101806160 DLGLOBAL DEBUG validating counter group 0x7f82c33e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101806160 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101806160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101806161 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101806161 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101806162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101806163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101806163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101806163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:07.107934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Terminating (SIGTERM) 10:18:07.147921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Terminating (SIGTERM) 10:18:07.187275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28020): Terminating (SIGTERM) 10:18:07.226956 --- ParallelTerminationStrategy: PID 28014 died... 10:18:07.245912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28014): Terminated: ok {rc=0} 10:18:07.289459 --- ParallelTerminationStrategy: PID 28017 died... 10:18:07.307709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28017): Terminated: ok {rc=0} 10:18:07.351302 --- ParallelTerminationStrategy: PID 28020 died... 10:18:07.369699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28020): Terminated: ok {rc=0} 10:18:07.455356 bus /sierra_3: Setting Powered False 10:18:08.556434 bus /sierra_3: Setting Powered False 10:18:09.675457 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:18:10.931253 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:10.937619 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:18:10.971264 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:18:10.997871 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:18:11.049393 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:18:11.083247 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:18:11.109486 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:18:11.661876 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:18:11.710007 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:11.721345 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:18:11.791564 tst mo_mt_call.py: using LAC 27706 10:18:11.909327 tst mo_mt_call.py: using RAC 166 10:18:12.027708 tst mo_mt_call.py: using CellId 27706 10:18:12.150076 tst mo_mt_call.py: using BVCI 27707 10:18:12.260056 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:12.271367 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:12.282492 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:12.293533 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:12.304606 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:12.315801 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:18:12.434135 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:18:12.551166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:13.018543 run create_hlr_db(pid=28026): Launched 10:18:13.142165 bus /sierra_2: Setting Powered False 10:18:14.202051 run create_hlr_db(pid=28026): Terminated: ok {rc=0} 10:18:14.641496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28028): Launched 10:18:14.964890 run osmo-hlr_10.42.42.2(pid=28029): Launched 10:18:15.089534 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:15.646646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28031): Launched 10:18:15.987044 run osmo-stp_10.42.42.5(pid=28032): Launched 10:18:16.215648 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:16.870720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28034): Launched 10:18:17.208589 run osmo-msc_10.42.42.6(pid=28035): Launched 10:18:17.389803 run osmo-stp_10.42.42.5(pid=28032): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28032)] 10:18:17.525969 run osmo-stp_10.42.42.5(pid=28032): stdout: | (launched: 2022-12-10_10:18:15.923266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:17.664150 run osmo-stp_10.42.42.5(pid=28032): stderr: | 20221210101816209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101816210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101816210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101816210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101816212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101816224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101816224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:17.800425 run osmo-stp_10.42.42.5(pid=28032): stdout: | (launched: 2022-12-10_10:18:15.923266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:17.928882 run osmo-stp_10.42.42.5(pid=28032): stderr: | 20221210101816209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101816210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101816210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101816210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101816212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101816224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101816224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:18.083444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28032): Process ended prematurely: osmo-stp_10.42.42.5(pid=28032) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28032)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:18:18.093045 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:18:18.121795 run osmo-hlr_10.42.42.2(pid=28029): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28029)] 10:18:18.171984 run osmo-hlr_10.42.42.2(pid=28029): stdout: | (launched: 2022-12-10_10:18:14.906565) 10:18:18.223846 run osmo-hlr_10.42.42.2(pid=28029): stderr: | 20221210101815104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101815104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101815104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101815104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101815104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101815104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101815116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101815125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101815125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101815125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:18.296133 run osmo-msc_10.42.42.6(pid=28035): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28035)] 10:18:18.346345 run osmo-msc_10.42.42.6(pid=28035): stdout: | (launched: 2022-12-10_10:18:17.149711) 10:18:18.398519 run osmo-msc_10.42.42.6(pid=28035): stderr: | 20221210101817472 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101817472 DLGLOBAL DEBUG validating counter group 0x7f15a837bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101817472 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101817472 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101817473 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101817473 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101817474 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101817475 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101817475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101817475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:18.450737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28028): Terminating (SIGTERM) 10:18:18.492433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28031): Terminating (SIGTERM) 10:18:18.534422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28034): Terminating (SIGTERM) 10:18:18.576505 --- ParallelTerminationStrategy: PID 28028 died... 10:18:18.596441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28028): Terminated: ok {rc=0} 10:18:18.642752 --- ParallelTerminationStrategy: PID 28031 died... 10:18:18.662100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28031): Terminated: ok {rc=0} 10:18:18.708305 --- ParallelTerminationStrategy: PID 28034 died... 10:18:18.727675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28034): Terminated: ok {rc=0} 10:18:18.816182 bus /sierra_3: Setting Powered False 10:18:19.915211 bus /sierra_3: Setting Powered False 10:18:21.029523 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:18:22.180440 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:22.192690 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:18:22.265635 tst mo_mt_call_osmux.py: using LAC 27707 10:18:22.393196 tst mo_mt_call_osmux.py: using RAC 167 10:18:22.520191 tst mo_mt_call_osmux.py: using CellId 27707 10:18:22.647178 tst mo_mt_call_osmux.py: using BVCI 27708 10:18:22.767232 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:22.779074 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:22.790640 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:22.802573 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:22.814702 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:18:22.826670 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:18:22.945344 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:18:23.064471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:23.564739 run create_hlr_db(pid=28037): Launched 10:18:23.688883 bus /sierra_2: Setting Powered False 10:18:24.753027 run create_hlr_db(pid=28037): Terminated: ok {rc=0} 10:18:25.185941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28039): Launched 10:18:25.488721 run osmo-hlr_10.42.42.2(pid=28040): Launched 10:18:25.605445 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:26.124613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28042): Launched 10:18:26.425698 run osmo-stp_10.42.42.5(pid=28043): Launched 10:18:26.541198 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:27.086935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28045): Launched 10:18:27.389321 run osmo-msc_10.42.42.6(pid=28046): Launched 10:18:27.559975 run osmo-stp_10.42.42.5(pid=28043): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28043)] 10:18:27.688324 run osmo-stp_10.42.42.5(pid=28043): stdout: | (launched: 2022-12-10_10:18:26.371090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:27.815977 run osmo-stp_10.42.42.5(pid=28043): stderr: | 20221210101826543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101826543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101826543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101826544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101826544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101826544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101826544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:27.942096 run osmo-stp_10.42.42.5(pid=28043): stdout: | (launched: 2022-12-10_10:18:26.371090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:28.062332 run osmo-stp_10.42.42.5(pid=28043): stderr: | 20221210101826543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101826543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101826543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101826544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101826544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101826544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101826544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:28.206037 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28043): Process ended prematurely: osmo-stp_10.42.42.5(pid=28043) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28043)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:18:28.215062 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:18:28.241230 run osmo-hlr_10.42.42.2(pid=28040): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28040)] 10:18:28.288756 run osmo-hlr_10.42.42.2(pid=28040): stdout: | (launched: 2022-12-10_10:18:25.434057) 10:18:28.338109 run osmo-hlr_10.42.42.2(pid=28040): stderr: | 20221210101825610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101825611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101825611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101825611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101825611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101825611 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101825627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101825637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101825637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101825637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:28.406594 run osmo-msc_10.42.42.6(pid=28046): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28046)] 10:18:28.454224 run osmo-msc_10.42.42.6(pid=28046): stdout: | (launched: 2022-12-10_10:18:27.334781) 10:18:28.502954 run osmo-msc_10.42.42.6(pid=28046): stderr: | 20221210101827603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101827603 DLGLOBAL DEBUG validating counter group 0x7fd43d7edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101827603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101827603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101827604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101827604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101827606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101827606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101827606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101827606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:28.552170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28039): Terminating (SIGTERM) 10:18:28.591591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28042): Terminating (SIGTERM) 10:18:28.630916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28045): Terminating (SIGTERM) 10:18:28.670740 --- ParallelTerminationStrategy: PID 28039 died... 10:18:28.689881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28039): Terminated: ok {rc=0} 10:18:28.734130 --- ParallelTerminationStrategy: PID 28042 died... 10:18:28.752827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28042): Terminated: ok {rc=0} 10:18:28.797054 --- ParallelTerminationStrategy: PID 28045 died... 10:18:28.815634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28045): Terminated: ok {rc=0} 10:18:28.901123 bus /sierra_3: Setting Powered False 10:18:30.001667 bus /sierra_3: Setting Powered False 10:18:31.116775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:18:32.377952 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:32.384791 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:18:32.421728 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:18:32.449662 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:18:32.503434 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:18:32.537747 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:18:32.564684 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:18:33.117271 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:18:33.169585 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:33.181286 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:33.255853 tst mo_mt_call.py: using LAC 27708 10:18:33.381530 tst mo_mt_call.py: using RAC 168 10:18:33.498945 tst mo_mt_call.py: using CellId 27708 10:18:33.618288 tst mo_mt_call.py: using BVCI 27709 10:18:33.726843 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:33.738023 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:33.749043 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:33.759889 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:33.770863 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:33.781722 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:33.901793 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:34.021790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:34.519225 run create_hlr_db(pid=28051): Launched 10:18:34.643292 bus /sierra_2: Setting Powered False 10:18:35.707110 run create_hlr_db(pid=28051): Terminated: ok {rc=0} 10:18:36.156146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28053): Launched 10:18:36.479023 run osmo-hlr_10.42.42.2(pid=28054): Launched 10:18:36.603490 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:37.158256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28056): Launched 10:18:37.481387 run osmo-stp_10.42.42.5(pid=28057): Launched 10:18:37.606475 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:38.193657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28059): Launched 10:18:38.517884 run osmo-msc_10.42.42.6(pid=28060): Launched 10:18:38.698840 run osmo-stp_10.42.42.5(pid=28057): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28057)] 10:18:38.835634 run osmo-stp_10.42.42.5(pid=28057): stdout: | (launched: 2022-12-10_10:18:37.423327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:38.973756 run osmo-stp_10.42.42.5(pid=28057): stderr: | 20221210101837615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101837615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101837616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101837616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101837618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101837618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101837619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:39.110397 run osmo-stp_10.42.42.5(pid=28057): stdout: | (launched: 2022-12-10_10:18:37.423327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:39.239078 run osmo-stp_10.42.42.5(pid=28057): stderr: | 20221210101837615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101837615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101837616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101837616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101837618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101837618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101837619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:39.393887 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28057): Process ended prematurely: osmo-stp_10.42.42.5(pid=28057) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28057)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:18:39.403473 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:18:39.431433 run osmo-hlr_10.42.42.2(pid=28054): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28054)] 10:18:39.482063 run osmo-hlr_10.42.42.2(pid=28054): stdout: | (launched: 2022-12-10_10:18:36.420926) 10:18:39.534371 run osmo-hlr_10.42.42.2(pid=28054): stderr: | 20221210101836620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101836620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101836620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101836620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101836620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101836620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101836664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101836674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101836674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101836674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:39.606551 run osmo-msc_10.42.42.6(pid=28060): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28060)] 10:18:39.657300 run osmo-msc_10.42.42.6(pid=28060): stdout: | (launched: 2022-12-10_10:18:38.459525) 10:18:39.709421 run osmo-msc_10.42.42.6(pid=28060): stderr: | 20221210101838782 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101838782 DLGLOBAL DEBUG validating counter group 0x7f4f71e96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101838782 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101838782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101838782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101838782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101838784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101838784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101838785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101838785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:39.761989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28053): Terminating (SIGTERM) 10:18:39.804084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28056): Terminating (SIGTERM) 10:18:39.846347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28059): Terminating (SIGTERM) 10:18:39.888760 --- ParallelTerminationStrategy: PID 28053 died... 10:18:39.908811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28053): Terminated: ok {rc=0} 10:18:39.956440 --- ParallelTerminationStrategy: PID 28056 died... 10:18:39.975981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28056): Terminated: ok {rc=0} 10:18:40.023107 --- ParallelTerminationStrategy: PID 28059 died... 10:18:40.042872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28059): Terminated: ok {rc=0} 10:18:40.132161 bus /sierra_3: Setting Powered False 10:18:41.230818 bus /sierra_3: Setting Powered False 10:18:42.347081 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:18:43.499139 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:43.511414 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:18:43.586575 tst mo_mt_call_osmux.py: using LAC 27709 10:18:43.706274 tst mo_mt_call_osmux.py: using RAC 169 10:18:43.827561 tst mo_mt_call_osmux.py: using CellId 27709 10:18:43.950535 tst mo_mt_call_osmux.py: using BVCI 27710 10:18:44.061913 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:44.072817 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:44.083800 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:44.094619 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:44.105745 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:18:44.116545 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:44.235557 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:18:44.360743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:44.858322 run create_hlr_db(pid=28062): Launched 10:18:44.983225 bus /sierra_2: Setting Powered False 10:18:46.046461 run create_hlr_db(pid=28062): Terminated: ok {rc=0} 10:18:46.506895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28064): Launched 10:18:46.848098 run osmo-hlr_10.42.42.2(pid=28065): Launched 10:18:46.988654 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:47.588315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28067): Launched 10:18:47.890205 run osmo-stp_10.42.42.5(pid=28068): Launched 10:18:48.005300 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:48.551199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28070): Launched 10:18:48.853289 run osmo-msc_10.42.42.6(pid=28071): Launched 10:18:49.022950 run osmo-stp_10.42.42.5(pid=28068): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28068)] 10:18:49.151113 run osmo-stp_10.42.42.5(pid=28068): stdout: | (launched: 2022-12-10_10:18:47.835897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:49.279627 run osmo-stp_10.42.42.5(pid=28068): stderr: | 20221210101848007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101848007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101848007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101848008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101848008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101848009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101848009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:49.405954 run osmo-stp_10.42.42.5(pid=28068): stdout: | (launched: 2022-12-10_10:18:47.835897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:18:49.527091 run osmo-stp_10.42.42.5(pid=28068): stderr: | 20221210101848007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101848007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101848007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101848008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101848008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101848009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101848009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:18:49.671129 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28068): Process ended prematurely: osmo-stp_10.42.42.5(pid=28068) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28068)] [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:18:49.680009 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:18:49.706399 run osmo-hlr_10.42.42.2(pid=28065): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28065)] 10:18:49.754328 run osmo-hlr_10.42.42.2(pid=28065): stdout: | (launched: 2022-12-10_10:18:46.785357) 10:18:49.803736 run osmo-hlr_10.42.42.2(pid=28065): stderr: | 20221210101847145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101847145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101847145 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101847145 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101847145 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101847145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101847160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101847170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101847170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101847170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:18:49.872358 run osmo-msc_10.42.42.6(pid=28071): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28071)] 10:18:49.920218 run osmo-msc_10.42.42.6(pid=28071): stdout: | (launched: 2022-12-10_10:18:48.798425) 10:18:49.969602 run osmo-msc_10.42.42.6(pid=28071): stderr: | 20221210101849069 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101849070 DLGLOBAL DEBUG validating counter group 0x7f109d5f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101849070 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101849070 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101849070 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101849070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101849072 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101849072 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101849072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101849072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:18:50.019289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28064): Terminating (SIGTERM) 10:18:50.058809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28067): Terminating (SIGTERM) 10:18:50.098430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28070): Terminating (SIGTERM) 10:18:50.138351 --- ParallelTerminationStrategy: PID 28064 died... 10:18:50.157271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28064): Terminated: ok {rc=0} 10:18:50.201211 --- ParallelTerminationStrategy: PID 28067 died... 10:18:50.219670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28067): Terminated: ok {rc=0} 10:18:50.263483 --- ParallelTerminationStrategy: PID 28070 died... 10:18:50.282166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28070): Terminated: ok {rc=0} 10:18:50.365018 bus /sierra_3: Setting Powered False 10:18:51.461590 bus /sierra_3: Setting Powered False 10:18:52.575393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 10:18:53.826462 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:18:53.830736 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:18:53.865849 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 10:18:53.892792 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:18:53.978224 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:18:54.012126 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 10:18:54.038958 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:18:54.623208 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 10:18:54.627975 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:54.638771 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:18:54.690334 tst emergency_mo_mt_call.py: using LAC 27710 10:18:54.809833 tst emergency_mo_mt_call.py: using RAC 170 10:18:54.932343 tst emergency_mo_mt_call.py: using CellId 27710 10:18:55.050885 tst emergency_mo_mt_call.py: using BVCI 27711 10:18:55.158700 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:55.169639 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:55.180112 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:55.191106 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:55.202209 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:18:55.213436 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:18:55.332620 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:18:55.449472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:18:55.939204 run create_hlr_db(pid=28076): Launched 10:18:56.061107 bus /sierra_2: Setting Powered False 10:18:57.124192 run create_hlr_db(pid=28076): Terminated: ok {rc=0} 10:18:57.567056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28078): Launched 10:18:57.883392 run osmo-hlr_10.42.42.2(pid=28079): Launched 10:18:58.004915 run osmo-stp_10.42.42.5: Starting osmo-stp 10:18:58.547008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28081): Launched 10:18:58.862740 run osmo-stp_10.42.42.5(pid=28082): Launched 10:18:58.996458 tst emergency_mo_mt_call.py: using MSISDN 7683 10:18:59.158971 run osmo-msc_10.42.42.6: Starting osmo-msc 10:18:59.729157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28084): Launched 10:19:00.045452 run osmo-msc_10.42.42.6(pid=28085): Launched 10:19:00.224062 run osmo-stp_10.42.42.5(pid=28082): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28082)] 10:19:00.358976 run osmo-stp_10.42.42.5(pid=28082): stdout: | (launched: 2022-12-10_10:18:58.806030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:00.494179 run osmo-stp_10.42.42.5(pid=28082): stderr: | 20221210101859000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101859000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101859000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101859000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101859001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101859001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101859001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:00.628181 run osmo-stp_10.42.42.5(pid=28082): stdout: | (launched: 2022-12-10_10:18:58.806030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:00.754912 run osmo-stp_10.42.42.5(pid=28082): stderr: | 20221210101859000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101859000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101859000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101859000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101859001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101859001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101859001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:00.907957 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28082): Process ended prematurely: osmo-stp_10.42.42.5(pid=28082) [trial-2373↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28082)] [trial-2373↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 10:19:00.917521 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 10:19:00.946687 run osmo-hlr_10.42.42.2(pid=28079): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28079)] 10:19:00.998777 run osmo-hlr_10.42.42.2(pid=28079): stdout: | (launched: 2022-12-10_10:18:57.826549) 10:19:01.052552 run osmo-hlr_10.42.42.2(pid=28079): stderr: | 20221210101858023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101858023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101858023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101858023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101858023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101858023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101858061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101858070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101858070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101858070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:01.126840 run osmo-msc_10.42.42.6(pid=28085): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28085)] 10:19:01.179227 run osmo-msc_10.42.42.6(pid=28085): stdout: | (launched: 2022-12-10_10:18:59.988425) 10:19:01.233339 run osmo-msc_10.42.42.6(pid=28085): stderr: | 20221210101900306 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101900306 DLGLOBAL DEBUG validating counter group 0x7f151edf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101900306 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101900306 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101900306 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101900306 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101900308 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101900309 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101900309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101900309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:19:01.287892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28078): Terminating (SIGTERM) 10:19:01.332869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28081): Terminating (SIGTERM) 10:19:01.378270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28084): Terminating (SIGTERM) 10:19:01.423202 --- ParallelTerminationStrategy: PID 28078 died... 10:19:01.443867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28078): Terminated: ok {rc=0} 10:19:01.494464 --- ParallelTerminationStrategy: PID 28081 died... 10:19:01.514960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28081): Terminated: ok {rc=0} 10:19:01.564264 --- ParallelTerminationStrategy: PID 28084 died... 10:19:01.584643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28084): Terminated: ok {rc=0} 10:19:01.676556 bus /sierra_3: Setting Powered False 10:19:02.776345 bus /sierra_3: Setting Powered False 10:19:03.892188 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 10:19:04.978251 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:19:04.990087 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:19:05.045194 tst emergency_preemptive_call.py: using LAC 27711 10:19:05.169031 tst emergency_preemptive_call.py: using RAC 171 10:19:05.292823 tst emergency_preemptive_call.py: using CellId 27711 10:19:05.417338 tst emergency_preemptive_call.py: using BVCI 27712 10:19:05.533526 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:19:05.544793 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:19:05.555892 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:19:05.567748 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:19:05.579690 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 10:19:05.591588 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:05.709052 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:05.824103 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:05.942692 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:06.056807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:06.515162 run create_hlr_db(pid=28087): Launched 10:19:06.638441 bus /sierra_2: Setting Powered False 10:19:07.697920 run create_hlr_db(pid=28087): Terminated: ok {rc=0} 10:19:08.111343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28089): Launched 10:19:08.406655 run osmo-hlr_10.42.42.2(pid=28090): Launched 10:19:08.518780 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:09.027651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28092): Launched 10:19:09.323991 run osmo-stp_10.42.42.5(pid=28093): Launched 10:19:09.447392 tst emergency_preemptive_call.py: using MSISDN 7684 10:19:09.617567 run osmo-msc_10.42.42.6: Starting osmo-msc 10:19:10.151961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28095): Launched 10:19:10.448812 run osmo-msc_10.42.42.6(pid=28096): Launched 10:19:10.615468 run osmo-stp_10.42.42.5(pid=28093): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28093)] 10:19:10.741163 run osmo-stp_10.42.42.5(pid=28093): stdout: | (launched: 2022-12-10_10:19:09.269945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:10.867018 run osmo-stp_10.42.42.5(pid=28093): stderr: | 20221210101909441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101909441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101909441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101909442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101909442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101909442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101909442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:10.991349 run osmo-stp_10.42.42.5(pid=28093): stdout: | (launched: 2022-12-10_10:19:09.269945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:11.109831 run osmo-stp_10.42.42.5(pid=28093): stderr: | 20221210101909441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101909441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101909441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101909442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101909442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101909442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101909442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:11.250830 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28093): Process ended prematurely: osmo-stp_10.42.42.5(pid=28093) [trial-2373↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28093)] [trial-2373↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 10:19:11.259209 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 10:19:11.285368 run osmo-hlr_10.42.42.2(pid=28090): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28090)] 10:19:11.333352 run osmo-hlr_10.42.42.2(pid=28090): stdout: | (launched: 2022-12-10_10:19:08.353331) 10:19:11.383076 run osmo-hlr_10.42.42.2(pid=28090): stderr: | 20221210101908527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101908527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101908527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101908527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101908527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101908527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101908539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101908548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101908548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101908548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:11.452160 run osmo-msc_10.42.42.6(pid=28096): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28096)] 10:19:11.500067 run osmo-msc_10.42.42.6(pid=28096): stdout: | (launched: 2022-12-10_10:19:10.394683) 10:19:11.549540 run osmo-msc_10.42.42.6(pid=28096): stderr: | 20221210101910669 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210101910669 DLGLOBAL DEBUG validating counter group 0x7fd68ae8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210101910669 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210101910669 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210101910669 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210101910670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210101910671 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210101910672 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210101910672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210101910672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:19:11.599191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28089): Terminating (SIGTERM) 10:19:11.639020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28092): Terminating (SIGTERM) 10:19:11.678726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28095): Terminating (SIGTERM) 10:19:11.718540 --- ParallelTerminationStrategy: PID 28089 died... 10:19:11.737577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28089): Terminated: ok {rc=0} 10:19:11.781996 --- ParallelTerminationStrategy: PID 28092 died... 10:19:11.800636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28092): Terminated: ok {rc=0} 10:19:11.844329 --- ParallelTerminationStrategy: PID 28095 died... 10:19:11.863048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28095): Terminated: ok {rc=0} 10:19:11.953094 bus /sierra_9: Setting Powered False 10:19:13.050945 bus /sierra_9: Setting Powered False 10:19:14.166542 bus /sierra_8: Setting Powered False 10:19:15.263389 bus /sierra_8: Setting Powered False 10:19:16.386172 bus /sierra_3: Setting Powered False 10:19:17.493328 bus /sierra_3: Setting Powered False 10:19:18.608503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 10:19:19.891885 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:19:19.896189 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 10:19:19.929692 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 10:19:19.967905 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 10:19:20.055180 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 10:19:20.088111 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 10:19:20.125833 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 10:19:20.721469 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 10:19:20.770804 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:20.781700 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:19:20.828902 tst cs_paging_gprs_active.py: using LAC 27712 10:19:20.945981 tst cs_paging_gprs_active.py: using RAC 172 10:19:21.063803 tst cs_paging_gprs_active.py: using CellId 27712 10:19:21.185966 tst cs_paging_gprs_active.py: using BVCI 27713 10:19:21.297037 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.307693 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.318197 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.328642 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.339027 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.349470 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.359959 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.370294 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:21.380816 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:21.500018 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:21.616735 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:19:21.821140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:22.123898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28103): Launched 10:19:22.389163 run iperf3-srv_10.42.42.10(pid=28104): Launched 10:19:22.502942 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:19:22.706176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:23.028181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28105): Launched 10:19:23.311630 run iperf3-srv_10.42.42.10(pid=28106): Launched 10:19:23.433866 tst cs_paging_gprs_active.py:38: start network... 10:19:23.652431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:24.154464 run create_hlr_db(pid=28107): Launched 10:19:24.278627 bus /sierra_2: Setting Powered False 10:19:25.342277 run create_hlr_db(pid=28107): Terminated: ok {rc=0} 10:19:25.777248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28109): Launched 10:19:26.080694 run osmo-hlr_10.42.42.2(pid=28110): Launched 10:19:26.197277 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:26.718304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28112): Launched 10:19:27.021401 run osmo-stp_10.42.42.5(pid=28113): Launched 10:19:27.138227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:27.662944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28115): Launched 10:19:27.779877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:28.035345 run patchelf(pid=28116): Launched 10:19:28.204665 run osmo-stp_10.42.42.5(pid=28113): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28113)] 10:19:28.332892 run osmo-stp_10.42.42.5(pid=28113): stdout: | (launched: 2022-12-10_10:19:26.966332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:28.463038 run osmo-stp_10.42.42.5(pid=28113): stderr: | 20221210101927137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101927138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101927138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101927138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101927139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101927139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101927139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:28.592657 run osmo-stp_10.42.42.5(pid=28113): stdout: | (launched: 2022-12-10_10:19:26.966332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:28.716582 run osmo-stp_10.42.42.5(pid=28113): stderr: | 20221210101927137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101927138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101927138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101927138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101927139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101927139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101927139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:28.863543 run patchelf(pid=28116): Terminating (SIGINT) 10:19:29.034131 run patchelf(pid=28116): Terminated: ok {rc=0} 10:19:29.157368 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28113): Process ended prematurely: osmo-stp_10.42.42.5(pid=28113) [trial-2373↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28113)] [trial-2373↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 10:19:29.166752 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 10:19:29.193725 run osmo-hlr_10.42.42.2(pid=28110): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28110)] 10:19:29.240891 run osmo-hlr_10.42.42.2(pid=28110): stdout: | (launched: 2022-12-10_10:19:26.026074) 10:19:29.289882 run osmo-hlr_10.42.42.2(pid=28110): stderr: | 20221210101926203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101926203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101926203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101926203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101926203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101926204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101926216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101926226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101926227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101926227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:29.339251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28103): Terminating (SIGTERM) 10:19:29.378935 run iperf3-srv_10.42.42.10(pid=28104): Terminating (SIGTERM) 10:19:29.418457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28105): Terminating (SIGTERM) 10:19:29.458073 run iperf3-srv_10.42.42.10(pid=28106): Terminating (SIGTERM) 10:19:29.497673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28109): Terminating (SIGTERM) 10:19:29.537231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28112): Terminating (SIGTERM) 10:19:29.576617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28115): Terminating (SIGTERM) 10:19:29.616546 --- ParallelTerminationStrategy: PID 28103 died... 10:19:29.635633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28103): Terminated: ok {rc=0} 10:19:29.679403 --- ParallelTerminationStrategy: PID 28104 died... 10:19:29.697729 run iperf3-srv_10.42.42.10(pid=28104): Terminated {rc=256} 10:19:29.741194 --- ParallelTerminationStrategy: PID 28105 died... 10:19:29.759605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28105): Terminated: ok {rc=0} 10:19:29.803709 --- ParallelTerminationStrategy: PID 28106 died... 10:19:29.822217 run iperf3-srv_10.42.42.10(pid=28106): Terminated {rc=256} 10:19:29.865975 --- ParallelTerminationStrategy: PID 28109 died... 10:19:29.884503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28109): Terminated: ok {rc=0} 10:19:29.927694 --- ParallelTerminationStrategy: PID 28112 died... 10:19:29.946196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28112): Terminated: ok {rc=0} 10:19:29.990006 --- ParallelTerminationStrategy: PID 28115 died... 10:19:30.008559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28115): Terminated: ok {rc=0} 10:19:30.094780 bus /gobi_0: Setting Powered False 10:19:31.202077 bus /gobi_0: Setting Powered False 10:19:32.326310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 10:19:33.469748 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:33.480785 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:19:33.532882 tst iperf3.py: using LAC 27713 10:19:33.650985 tst iperf3.py: using RAC 173 10:19:33.770409 tst iperf3.py: using CellId 27713 10:19:33.892261 tst iperf3.py: using BVCI 27714 10:19:34.003623 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.014477 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.024912 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.035403 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.045889 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.056220 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.066833 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.077180 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:34.087652 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:34.206370 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:19:34.426589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:34.750689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28117): Launched 10:19:35.033550 run iperf3-srv_10.42.42.10(pid=28118): Launched 10:19:35.155693 tst iperf3.py:8: start network... 10:19:35.375178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:35.878502 run create_hlr_db(pid=28119): Launched 10:19:36.003170 bus /gobi_6: Setting Powered False 10:19:37.066726 run create_hlr_db(pid=28119): Terminated: ok {rc=0} 10:19:37.518008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28121): Launched 10:19:37.843358 run osmo-hlr_10.42.42.2(pid=28122): Launched 10:19:37.967827 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:38.530497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28124): Launched 10:19:38.855575 run osmo-stp_10.42.42.5(pid=28125): Launched 10:19:38.980202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:39.540691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28127): Launched 10:19:39.665726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:39.938695 run patchelf(pid=28128): Launched 10:19:40.121181 run osmo-stp_10.42.42.5(pid=28125): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28125)] 10:19:40.259201 run osmo-stp_10.42.42.5(pid=28125): stdout: | (launched: 2022-12-10_10:19:38.797230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:40.398894 run osmo-stp_10.42.42.5(pid=28125): stderr: | 20221210101938992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101938992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101938992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101938992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101938993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101938993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101938993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:40.538213 run osmo-stp_10.42.42.5(pid=28125): stdout: | (launched: 2022-12-10_10:19:38.797230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:40.671614 run osmo-stp_10.42.42.5(pid=28125): stderr: | 20221210101938992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101938992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101938992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101938992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101938993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101938993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101938993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:40.829222 run patchelf(pid=28128): Terminating (SIGINT) 10:19:41.011387 run patchelf(pid=28128): Terminated: ok {rc=0} 10:19:41.143582 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28125): Process ended prematurely: osmo-stp_10.42.42.5(pid=28125) [trial-2373↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28125)] [trial-2373↪gprs:trx-sysmocell5000↪iperf3.py:8] 10:19:41.153768 tst iperf3.py:8: Test FAILED (7.7 sec) 10:19:41.183019 run osmo-hlr_10.42.42.2(pid=28122): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28122)] 10:19:41.233603 run osmo-hlr_10.42.42.2(pid=28122): stdout: | (launched: 2022-12-10_10:19:37.785092) 10:19:41.286094 run osmo-hlr_10.42.42.2(pid=28122): stderr: | 20221210101937983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101937983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101937983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101937983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101937983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101937983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101937995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101938003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101938004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101938004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:41.338996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28117): Terminating (SIGTERM) 10:19:41.381589 run iperf3-srv_10.42.42.10(pid=28118): Terminating (SIGTERM) 10:19:41.424006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28121): Terminating (SIGTERM) 10:19:41.466701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28124): Terminating (SIGTERM) 10:19:41.509278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28127): Terminating (SIGTERM) 10:19:41.552001 --- ParallelTerminationStrategy: PID 28117 died... 10:19:41.572157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28117): Terminated: ok {rc=0} 10:19:41.619781 --- ParallelTerminationStrategy: PID 28118 died... 10:19:41.639561 run iperf3-srv_10.42.42.10(pid=28118): Terminated {rc=256} 10:19:41.687076 --- ParallelTerminationStrategy: PID 28121 died... 10:19:41.706845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28121): Terminated: ok {rc=0} 10:19:41.753941 --- ParallelTerminationStrategy: PID 28124 died... 10:19:41.773692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28124): Terminated: ok {rc=0} 10:19:41.820731 --- ParallelTerminationStrategy: PID 28127 died... 10:19:41.840572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28127): Terminated: ok {rc=0} 10:19:41.930517 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 10:19:43.081493 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.093518 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:19:43.150027 tst iperf3m4.py: using LAC 27714 10:19:43.277098 tst iperf3m4.py: using RAC 174 10:19:43.401773 tst iperf3m4.py: using CellId 27714 10:19:43.527326 tst iperf3m4.py: using BVCI 27715 10:19:43.646337 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.657866 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.669196 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.680614 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.692012 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.703400 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.715042 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.726252 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:19:43.737913 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:43.855423 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:43.978450 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:44.095601 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:19:44.214641 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:19:44.417509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:44.721746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28129): Launched 10:19:44.986514 run iperf3-srv_10.42.42.10(pid=28130): Launched 10:19:45.100731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:19:45.304042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:45.608509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28131): Launched 10:19:45.873834 run iperf3-srv_10.42.42.10(pid=28132): Launched 10:19:46.017253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:19:46.222943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:46.545553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28133): Launched 10:19:46.825788 run iperf3-srv_10.42.42.10(pid=28134): Launched 10:19:46.948541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:19:47.154242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:19:47.458240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28135): Launched 10:19:47.722248 run iperf3-srv_10.42.42.10(pid=28136): Launched 10:19:47.835677 tst iperf3m4.py:8: start network... 10:19:48.038408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:19:48.505774 run create_hlr_db(pid=28137): Launched 10:19:48.630136 bus /gobi_6: Setting Powered False 10:19:49.690447 run create_hlr_db(pid=28137): Terminated: ok {rc=0} 10:19:50.131827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28140): Launched 10:19:50.455527 run osmo-hlr_10.42.42.2(pid=28141): Launched 10:19:50.580231 run osmo-stp_10.42.42.5: Starting osmo-stp 10:19:51.142195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28143): Launched 10:19:51.466061 run osmo-stp_10.42.42.5(pid=28144): Launched 10:19:51.591102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:19:52.151860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28146): Launched 10:19:52.277204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:19:52.550686 run patchelf(pid=28147): Launched 10:19:52.731686 run osmo-stp_10.42.42.5(pid=28144): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28144)] 10:19:52.869476 run osmo-stp_10.42.42.5(pid=28144): stdout: | (launched: 2022-12-10_10:19:51.408007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:53.008913 run osmo-stp_10.42.42.5(pid=28144): stderr: | 20221210101951601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101951601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101951602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101951602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101951602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101951602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101951602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:53.148238 run osmo-stp_10.42.42.5(pid=28144): stdout: | (launched: 2022-12-10_10:19:51.408007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:19:53.281361 run osmo-stp_10.42.42.5(pid=28144): stderr: | 20221210101951601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210101951601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210101951602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210101951602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210101951602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210101951602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210101951602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:19:53.438778 run patchelf(pid=28147): Terminating (SIGINT) 10:19:53.620495 run patchelf(pid=28147): Terminated: ok {rc=0} 10:19:53.752107 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28144): Process ended prematurely: osmo-stp_10.42.42.5(pid=28144) [trial-2373↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28144)] [trial-2373↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 10:19:53.762287 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:19:53.791856 run osmo-hlr_10.42.42.2(pid=28141): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28141)] 10:19:53.842764 run osmo-hlr_10.42.42.2(pid=28141): stdout: | (launched: 2022-12-10_10:19:50.397139) 10:19:53.895310 run osmo-hlr_10.42.42.2(pid=28141): stderr: | 20221210101950597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210101950597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210101950597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210101950597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210101950597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210101950597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210101950609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210101950617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210101950617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210101950617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:19:53.948462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28129): Terminating (SIGTERM) 10:19:53.991617 run iperf3-srv_10.42.42.10(pid=28130): Terminating (SIGTERM) 10:19:54.034289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28131): Terminating (SIGTERM) 10:19:54.077143 run iperf3-srv_10.42.42.10(pid=28132): Terminating (SIGTERM) 10:19:54.119788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28133): Terminating (SIGTERM) 10:19:54.162360 run iperf3-srv_10.42.42.10(pid=28134): Terminating (SIGTERM) 10:19:54.204706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28135): Terminating (SIGTERM) 10:19:54.247799 run iperf3-srv_10.42.42.10(pid=28136): Terminating (SIGTERM) 10:19:54.290330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28140): Terminating (SIGTERM) 10:19:54.332664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28143): Terminating (SIGTERM) 10:19:54.375130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28146): Terminating (SIGTERM) 10:19:54.417841 --- ParallelTerminationStrategy: PID 28129 died... 10:19:54.438248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28129): Terminated: ok {rc=0} 10:19:54.485839 --- ParallelTerminationStrategy: PID 28130 died... 10:19:54.505643 run iperf3-srv_10.42.42.10(pid=28130): Terminated {rc=256} 10:19:54.552442 --- ParallelTerminationStrategy: PID 28131 died... 10:19:54.572186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28131): Terminated: ok {rc=0} 10:19:54.619129 --- ParallelTerminationStrategy: PID 28132 died... 10:19:54.638796 run iperf3-srv_10.42.42.10(pid=28132): Terminated {rc=256} 10:19:54.685733 --- ParallelTerminationStrategy: PID 28133 died... 10:19:54.705508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28133): Terminated: ok {rc=0} 10:19:54.752400 --- ParallelTerminationStrategy: PID 28134 died... 10:19:54.772180 run iperf3-srv_10.42.42.10(pid=28134): Terminated {rc=256} 10:19:54.819138 --- ParallelTerminationStrategy: PID 28135 died... 10:19:54.838952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28135): Terminated: ok {rc=0} 10:19:54.885800 --- ParallelTerminationStrategy: PID 28136 died... 10:19:54.905542 run iperf3-srv_10.42.42.10(pid=28136): Terminated {rc=256} 10:19:54.952384 --- ParallelTerminationStrategy: PID 28140 died... 10:19:54.972284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28140): Terminated: ok {rc=0} 10:19:55.019800 --- ParallelTerminationStrategy: PID 28143 died... 10:19:55.039634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28143): Terminated: ok {rc=0} 10:19:55.086781 --- ParallelTerminationStrategy: PID 28146 died... 10:19:55.106594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28146): Terminated: ok {rc=0} 10:19:55.195541 bus /gobi_4: Setting Powered False 10:19:56.295601 bus /gobi_4: Setting Powered False 10:19:57.412551 bus /gobi_1: Setting Powered False 10:19:58.510856 bus /gobi_1: Setting Powered False 10:19:59.626608 bus /gobi_0: Setting Powered False 10:20:00.724326 bus /gobi_0: Setting Powered False 10:20:01.843562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 10:20:02.945121 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:02.956438 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:20:03.007207 tst ping.py: using LAC 27715 10:20:03.126245 tst ping.py: using RAC 175 10:20:03.245284 tst ping.py: using CellId 27715 10:20:03.362630 tst ping.py: using BVCI 27716 10:20:03.472340 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:03.483088 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:03.493847 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:03.504847 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:03.515876 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:03.526894 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:03.538040 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:03.549237 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:20:03.666442 tst ping.py:19: start network... 10:20:03.882555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:04.374846 run create_hlr_db(pid=28151): Launched 10:20:04.495787 bus /gobi_6: Setting Powered False 10:20:05.558293 run create_hlr_db(pid=28151): Terminated: ok {rc=0} 10:20:05.982816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28153): Launched 10:20:06.280350 run osmo-hlr_10.42.42.2(pid=28154): Launched 10:20:06.394076 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:06.906407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28156): Launched 10:20:07.203627 run osmo-stp_10.42.42.5(pid=28157): Launched 10:20:07.317472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:07.831002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28159): Launched 10:20:07.945179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:08.195507 run patchelf(pid=28160): Launched 10:20:08.361961 run osmo-stp_10.42.42.5(pid=28157): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28157)] 10:20:08.487684 run osmo-stp_10.42.42.5(pid=28157): stdout: | (launched: 2022-12-10_10:20:07.149811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:08.615731 run osmo-stp_10.42.42.5(pid=28157): stderr: | 20221210102007318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102007319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102007319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102007319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102007320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102007320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102007320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:08.743555 run osmo-stp_10.42.42.5(pid=28157): stdout: | (launched: 2022-12-10_10:20:07.149811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:08.865510 run osmo-stp_10.42.42.5(pid=28157): stderr: | 20221210102007318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102007319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102007319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102007319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102007320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102007320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102007320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:09.009881 run patchelf(pid=28160): Terminating (SIGINT) 10:20:09.176710 run patchelf(pid=28160): Terminated: ok {rc=0} 10:20:09.297347 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28157): Process ended prematurely: osmo-stp_10.42.42.5(pid=28157) [trial-2373↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28157)] [trial-2373↪gprs:trx-sysmocell5000↪ping.py:22] 10:20:09.305950 tst ping.py:22: Test FAILED (6.4 sec) 10:20:09.332799 run osmo-hlr_10.42.42.2(pid=28154): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28154)] 10:20:09.380719 run osmo-hlr_10.42.42.2(pid=28154): stdout: | (launched: 2022-12-10_10:20:06.226812) 10:20:09.430170 run osmo-hlr_10.42.42.2(pid=28154): stderr: | 20221210102006404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102006404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102006404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102006404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102006404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102006404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102006419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102006427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102006428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102006428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:09.479828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28153): Terminating (SIGTERM) 10:20:09.519777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28156): Terminating (SIGTERM) 10:20:09.559675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28159): Terminating (SIGTERM) 10:20:09.599684 --- ParallelTerminationStrategy: PID 28153 died... 10:20:09.618934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28153): Terminated: ok {rc=0} 10:20:09.663305 --- ParallelTerminationStrategy: PID 28156 died... 10:20:09.682140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28156): Terminated: ok {rc=0} 10:20:09.726435 --- ParallelTerminationStrategy: PID 28159 died... 10:20:09.745114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28159): Terminated: ok {rc=0} 10:20:09.828767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 10:20:10.915952 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:10.928882 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 10:20:10.980346 tst ping_idle_ping.py: using LAC 27716 10:20:11.099180 tst ping_idle_ping.py: using RAC 176 10:20:11.217809 tst ping_idle_ping.py: using CellId 27716 10:20:11.334392 tst ping_idle_ping.py: using BVCI 27717 10:20:11.441902 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:11.452738 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:11.463466 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:11.474218 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:11.484671 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:11.495343 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:11.506134 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 10:20:11.516621 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 10:20:11.633193 tst ping_idle_ping.py:24: start network... 10:20:11.849619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:12.345256 run create_hlr_db(pid=28161): Launched 10:20:12.467249 bus /gobi_6: Setting Powered False 10:20:13.531107 run create_hlr_db(pid=28161): Terminated: ok {rc=0} 10:20:13.959343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28163): Launched 10:20:14.258445 run osmo-hlr_10.42.42.2(pid=28164): Launched 10:20:14.371893 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:14.902606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28166): Launched 10:20:15.200013 run osmo-stp_10.42.42.5(pid=28167): Launched 10:20:15.314324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:15.831121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28169): Launched 10:20:15.977065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:16.258379 run patchelf(pid=28170): Launched 10:20:16.456186 run osmo-stp_10.42.42.5(pid=28167): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28167)] 10:20:16.597476 run osmo-stp_10.42.42.5(pid=28167): stdout: | (launched: 2022-12-10_10:20:15.146095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:16.740308 run osmo-stp_10.42.42.5(pid=28167): stderr: | 20221210102015315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102015315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102015316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102015317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102015317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102015318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102015318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:16.882300 run osmo-stp_10.42.42.5(pid=28167): stdout: | (launched: 2022-12-10_10:20:15.146095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:17.025513 run osmo-stp_10.42.42.5(pid=28167): stderr: | 20221210102015315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102015315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102015316 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102015317 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102015317 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102015318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102015318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:17.184719 run patchelf(pid=28170): Terminating (SIGINT) 10:20:17.353242 run patchelf(pid=28170): Terminated: ok {rc=0} 10:20:17.474764 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28167): Process ended prematurely: osmo-stp_10.42.42.5(pid=28167) [trial-2373↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28167)] [trial-2373↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 10:20:17.483517 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:20:17.510429 run osmo-hlr_10.42.42.2(pid=28164): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28164)] 10:20:17.558065 run osmo-hlr_10.42.42.2(pid=28164): stdout: | (launched: 2022-12-10_10:20:14.204153) 10:20:17.607375 run osmo-hlr_10.42.42.2(pid=28164): stderr: | 20221210102014382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102014382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102014382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102014382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102014382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102014382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102014394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102014404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102014405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102014405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:17.657316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28163): Terminating (SIGTERM) 10:20:17.697280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28166): Terminating (SIGTERM) 10:20:17.737204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28169): Terminating (SIGTERM) 10:20:17.777381 --- ParallelTerminationStrategy: PID 28163 died... 10:20:17.796608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28163): Terminated: ok {rc=0} 10:20:17.840857 --- ParallelTerminationStrategy: PID 28166 died... 10:20:17.859951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28166): Terminated: ok {rc=0} 10:20:17.904019 --- ParallelTerminationStrategy: PID 28169 died... 10:20:17.922851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28169): Terminated: ok {rc=0} 10:20:18.009214 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 10:20:19.323975 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:20:19.329431 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:20:19.362899 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:20:19.400743 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:20:19.486318 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:20:19.519319 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:20:19.557234 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:20:20.153979 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:20:20.209200 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.220733 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:20:20.273660 tst cs_paging_gprs_active.py: using LAC 27717 10:20:20.397807 tst cs_paging_gprs_active.py: using RAC 177 10:20:20.516496 tst cs_paging_gprs_active.py: using CellId 27717 10:20:20.634423 tst cs_paging_gprs_active.py: using BVCI 27718 10:20:20.745879 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.756804 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.767690 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.778481 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.789128 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.799823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.810735 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.821384 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:20.832248 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:20.950360 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:21.070979 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:20:21.290914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:21.616084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28174): Launched 10:20:21.899661 run iperf3-srv_10.42.42.10(pid=28175): Launched 10:20:22.022766 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:20:22.243023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:22.568926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28176): Launched 10:20:22.851116 run iperf3-srv_10.42.42.10(pid=28177): Launched 10:20:22.973474 tst cs_paging_gprs_active.py:38: start network... 10:20:23.193370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:23.695229 run create_hlr_db(pid=28178): Launched 10:20:23.820539 bus /gobi_6: Setting Powered False 10:20:24.884613 run create_hlr_db(pid=28178): Terminated: ok {rc=0} 10:20:25.336607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28180): Launched 10:20:25.660400 run osmo-hlr_10.42.42.2(pid=28181): Launched 10:20:25.785395 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:26.343306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28183): Launched 10:20:26.668004 run osmo-stp_10.42.42.5(pid=28184): Launched 10:20:26.792076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:27.351482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28186): Launched 10:20:27.476261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:27.749672 run patchelf(pid=28187): Launched 10:20:27.931753 run osmo-stp_10.42.42.5(pid=28184): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28184)] 10:20:28.070774 run osmo-stp_10.42.42.5(pid=28184): stdout: | (launched: 2022-12-10_10:20:26.608607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:28.210978 run osmo-stp_10.42.42.5(pid=28184): stderr: | 20221210102026800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102026800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102026801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102026801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102026801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102026802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102026802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:28.351053 run osmo-stp_10.42.42.5(pid=28184): stdout: | (launched: 2022-12-10_10:20:26.608607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:28.484835 run osmo-stp_10.42.42.5(pid=28184): stderr: | 20221210102026800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102026800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102026801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102026801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102026801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102026802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102026802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:28.643465 run patchelf(pid=28187): Terminating (SIGINT) 10:20:28.826488 run patchelf(pid=28187): Terminated: ok {rc=0} 10:20:28.958683 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28184): Process ended prematurely: osmo-stp_10.42.42.5(pid=28184) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28184)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:20:28.968658 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:20:28.997983 run osmo-hlr_10.42.42.2(pid=28181): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28181)] 10:20:29.048454 run osmo-hlr_10.42.42.2(pid=28181): stdout: | (launched: 2022-12-10_10:20:25.602085) 10:20:29.100651 run osmo-hlr_10.42.42.2(pid=28181): stderr: | 20221210102025801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102025801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102025801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102025801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102025801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102025801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102025828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102025839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102025839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102025839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:29.152925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28174): Terminating (SIGTERM) 10:20:29.195107 run iperf3-srv_10.42.42.10(pid=28175): Terminating (SIGTERM) 10:20:29.237219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28176): Terminating (SIGTERM) 10:20:29.279575 run iperf3-srv_10.42.42.10(pid=28177): Terminating (SIGTERM) 10:20:29.321730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28180): Terminating (SIGTERM) 10:20:29.364061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28183): Terminating (SIGTERM) 10:20:29.406394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28186): Terminating (SIGTERM) 10:20:29.448491 --- ParallelTerminationStrategy: PID 28174 died... 10:20:29.468470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28174): Terminated: ok {rc=0} 10:20:29.515337 --- ParallelTerminationStrategy: PID 28175 died... 10:20:29.534882 run iperf3-srv_10.42.42.10(pid=28175): Terminated {rc=256} 10:20:29.581539 --- ParallelTerminationStrategy: PID 28176 died... 10:20:29.601090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28176): Terminated: ok {rc=0} 10:20:29.647756 --- ParallelTerminationStrategy: PID 28177 died... 10:20:29.667345 run iperf3-srv_10.42.42.10(pid=28177): Terminated {rc=256} 10:20:29.714103 --- ParallelTerminationStrategy: PID 28180 died... 10:20:29.733622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28180): Terminated: ok {rc=0} 10:20:29.780085 --- ParallelTerminationStrategy: PID 28183 died... 10:20:29.799649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28183): Terminated: ok {rc=0} 10:20:29.846476 --- ParallelTerminationStrategy: PID 28186 died... 10:20:29.866080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28186): Terminated: ok {rc=0} 10:20:29.955288 bus /gobi_0: Setting Powered False 10:20:31.052422 bus /gobi_0: Setting Powered False 10:20:32.164674 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:20:33.314087 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.326339 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:20:33.382645 tst iperf3.py: using LAC 27718 10:20:33.509180 tst iperf3.py: using RAC 178 10:20:33.634902 tst iperf3.py: using CellId 27718 10:20:33.761426 tst iperf3.py: using BVCI 27719 10:20:33.879980 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.891715 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.902969 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.914682 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.926282 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.937986 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.950051 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.961817 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:33.973802 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:34.092621 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:20:34.295246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:34.596771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28188): Launched 10:20:34.860553 run iperf3-srv_10.42.42.10(pid=28189): Launched 10:20:34.974605 tst iperf3.py:8: start network... 10:20:35.178286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:35.648677 run create_hlr_db(pid=28190): Launched 10:20:35.773345 bus /gobi_6: Setting Powered False 10:20:36.833974 run create_hlr_db(pid=28190): Terminated: ok {rc=0} 10:20:37.275130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Launched 10:20:37.599048 run osmo-hlr_10.42.42.2(pid=28193): Launched 10:20:37.723302 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:38.281169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Launched 10:20:38.603560 run osmo-stp_10.42.42.5(pid=28196): Launched 10:20:38.727123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:39.285829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28198): Launched 10:20:39.411784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:39.686557 run patchelf(pid=28199): Launched 10:20:39.868045 run osmo-stp_10.42.42.5(pid=28196): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] 10:20:40.006501 run osmo-stp_10.42.42.5(pid=28196): stdout: | (launched: 2022-12-10_10:20:38.545753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:40.146593 run osmo-stp_10.42.42.5(pid=28196): stderr: | 20221210102038738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102038738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102038738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102038739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102038739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102038739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102038739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:40.285577 run osmo-stp_10.42.42.5(pid=28196): stdout: | (launched: 2022-12-10_10:20:38.545753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:40.419216 run osmo-stp_10.42.42.5(pid=28196): stderr: | 20221210102038738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102038738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102038738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102038739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102038739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102038739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102038739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:40.577096 run patchelf(pid=28199): Terminating (SIGINT) 10:20:40.758795 run patchelf(pid=28199): Terminated: ok {rc=0} 10:20:40.889871 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28196): Process ended prematurely: osmo-stp_10.42.42.5(pid=28196) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 10:20:40.900032 tst iperf3.py:8: Test FAILED (7.6 sec) 10:20:40.929553 run osmo-hlr_10.42.42.2(pid=28193): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28193)] 10:20:40.980215 run osmo-hlr_10.42.42.2(pid=28193): stdout: | (launched: 2022-12-10_10:20:37.540924) 10:20:41.032924 run osmo-hlr_10.42.42.2(pid=28193): stderr: | 20221210102037740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102037741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102037741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102037741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102037741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102037741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102037753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102037763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102037763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102037763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:41.086038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28188): Terminating (SIGTERM) 10:20:41.128589 run iperf3-srv_10.42.42.10(pid=28189): Terminating (SIGTERM) 10:20:41.171240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Terminating (SIGTERM) 10:20:41.213718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Terminating (SIGTERM) 10:20:41.256355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28198): Terminating (SIGTERM) 10:20:41.299207 --- ParallelTerminationStrategy: PID 28188 died... 10:20:41.319344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28188): Terminated: ok {rc=0} 10:20:41.367124 --- ParallelTerminationStrategy: PID 28189 died... 10:20:41.386763 run iperf3-srv_10.42.42.10(pid=28189): Terminated {rc=256} 10:20:41.433762 --- ParallelTerminationStrategy: PID 28192 died... 10:20:41.453357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Terminated: ok {rc=0} 10:20:41.500069 --- ParallelTerminationStrategy: PID 28195 died... 10:20:41.519796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Terminated: ok {rc=0} 10:20:41.566775 --- ParallelTerminationStrategy: PID 28198 died... 10:20:41.586471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28198): Terminated: ok {rc=0} 10:20:41.675064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:20:42.824372 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:42.836570 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:20:42.890102 tst iperf3m4.py: using LAC 27719 10:20:43.018437 tst iperf3m4.py: using RAC 179 10:20:43.145621 tst iperf3m4.py: using CellId 27719 10:20:43.265810 tst iperf3m4.py: using BVCI 27720 10:20:43.375370 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.386437 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.397583 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.409058 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.420252 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.431514 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.442911 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.454285 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:20:43.465753 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:43.586401 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:43.706247 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:43.820106 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:20:43.938924 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:20:44.142416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:44.446901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28200): Launched 10:20:44.711769 run iperf3-srv_10.42.42.10(pid=28201): Launched 10:20:44.826665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:20:45.029998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:45.334380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28202): Launched 10:20:45.598480 run iperf3-srv_10.42.42.10(pid=28203): Launched 10:20:45.712665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:20:45.923653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:46.273935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28204): Launched 10:20:46.574233 run iperf3-srv_10.42.42.10(pid=28205): Launched 10:20:46.708240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:20:46.934848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:20:47.271142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28206): Launched 10:20:47.553259 run iperf3-srv_10.42.42.10(pid=28207): Launched 10:20:47.675110 tst iperf3m4.py:8: start network... 10:20:47.893738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:20:48.394858 run create_hlr_db(pid=28208): Launched 10:20:48.518935 bus /gobi_6: Setting Powered False 10:20:49.582704 run create_hlr_db(pid=28208): Terminated: ok {rc=0} 10:20:50.032481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28210): Launched 10:20:50.357364 run osmo-hlr_10.42.42.2(pid=28211): Launched 10:20:50.481978 run osmo-stp_10.42.42.5: Starting osmo-stp 10:20:51.044734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28213): Launched 10:20:51.369723 run osmo-stp_10.42.42.5(pid=28214): Launched 10:20:51.493526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:20:52.052453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28216): Launched 10:20:52.177693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:20:52.450890 run patchelf(pid=28217): Launched 10:20:52.631839 run osmo-stp_10.42.42.5(pid=28214): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28214)] 10:20:52.769969 run osmo-stp_10.42.42.5(pid=28214): stdout: | (launched: 2022-12-10_10:20:51.311086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:52.909715 run osmo-stp_10.42.42.5(pid=28214): stderr: | 20221210102051501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102051502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102051502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102051502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102051503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102051503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102051503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:53.049941 run osmo-stp_10.42.42.5(pid=28214): stdout: | (launched: 2022-12-10_10:20:51.311086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:20:53.183387 run osmo-stp_10.42.42.5(pid=28214): stderr: | 20221210102051501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102051502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102051502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102051502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102051503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102051503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102051503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:20:53.341673 run patchelf(pid=28217): Terminating (SIGINT) 10:20:53.523918 run patchelf(pid=28217): Terminated: ok {rc=0} 10:20:53.655552 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28214): Process ended prematurely: osmo-stp_10.42.42.5(pid=28214) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28214)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 10:20:53.665835 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:20:53.695406 run osmo-hlr_10.42.42.2(pid=28211): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28211)] 10:20:53.745732 run osmo-hlr_10.42.42.2(pid=28211): stdout: | (launched: 2022-12-10_10:20:50.298757) 10:20:53.797980 run osmo-hlr_10.42.42.2(pid=28211): stderr: | 20221210102050498 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102050498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102050498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102050499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102050499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102050499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102050511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102050520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102050520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102050520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:20:53.850752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28200): Terminating (SIGTERM) 10:20:53.893000 run iperf3-srv_10.42.42.10(pid=28201): Terminating (SIGTERM) 10:20:53.935253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28202): Terminating (SIGTERM) 10:20:53.977772 run iperf3-srv_10.42.42.10(pid=28203): Terminating (SIGTERM) 10:20:54.020167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28204): Terminating (SIGTERM) 10:20:54.062582 run iperf3-srv_10.42.42.10(pid=28205): Terminating (SIGTERM) 10:20:54.104852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28206): Terminating (SIGTERM) 10:20:54.147218 run iperf3-srv_10.42.42.10(pid=28207): Terminating (SIGTERM) 10:20:54.189309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28210): Terminating (SIGTERM) 10:20:54.231563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28213): Terminating (SIGTERM) 10:20:54.273849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28216): Terminating (SIGTERM) 10:20:54.316509 --- ParallelTerminationStrategy: PID 28200 died... 10:20:54.336737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28200): Terminated: ok {rc=0} 10:20:54.383664 --- ParallelTerminationStrategy: PID 28201 died... 10:20:54.403224 run iperf3-srv_10.42.42.10(pid=28201): Terminated {rc=256} 10:20:54.449906 --- ParallelTerminationStrategy: PID 28202 died... 10:20:54.469613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28202): Terminated: ok {rc=0} 10:20:54.516231 --- ParallelTerminationStrategy: PID 28203 died... 10:20:54.535841 run iperf3-srv_10.42.42.10(pid=28203): Terminated {rc=256} 10:20:54.582394 --- ParallelTerminationStrategy: PID 28204 died... 10:20:54.601937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28204): Terminated: ok {rc=0} 10:20:54.648463 --- ParallelTerminationStrategy: PID 28205 died... 10:20:54.668165 run iperf3-srv_10.42.42.10(pid=28205): Terminated {rc=256} 10:20:54.715355 --- ParallelTerminationStrategy: PID 28206 died... 10:20:54.735044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28206): Terminated: ok {rc=0} 10:20:54.781944 --- ParallelTerminationStrategy: PID 28207 died... 10:20:54.801604 run iperf3-srv_10.42.42.10(pid=28207): Terminated {rc=256} 10:20:54.848826 --- ParallelTerminationStrategy: PID 28210 died... 10:20:54.868848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28210): Terminated: ok {rc=0} 10:20:54.915452 --- ParallelTerminationStrategy: PID 28213 died... 10:20:54.935000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28213): Terminated: ok {rc=0} 10:20:54.981561 --- ParallelTerminationStrategy: PID 28216 died... 10:20:55.001248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28216): Terminated: ok {rc=0} 10:20:55.090351 bus /gobi_4: Setting Powered False 10:20:56.190439 bus /gobi_4: Setting Powered False 10:20:57.308140 bus /gobi_1: Setting Powered False 10:20:58.410885 bus /gobi_1: Setting Powered False 10:20:59.527617 bus /gobi_0: Setting Powered False 10:21:00.624845 bus /gobi_0: Setting Powered False 10:21:01.746149 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 10:21:02.857624 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:02.869225 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:21:02.920287 tst ping.py: using LAC 27720 10:21:03.039954 tst ping.py: using RAC 180 10:21:03.158526 tst ping.py: using CellId 27720 10:21:03.277394 tst ping.py: using BVCI 27721 10:21:03.385418 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:03.396445 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:03.407385 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:03.418250 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:03.428909 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:03.439672 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:03.450608 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:03.461429 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:21:03.578187 tst ping.py:19: start network... 10:21:03.793364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:04.284753 run create_hlr_db(pid=28218): Launched 10:21:04.406369 bus /gobi_6: Setting Powered False 10:21:05.470005 run create_hlr_db(pid=28218): Terminated: ok {rc=0} 10:21:05.896899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28220): Launched 10:21:06.194520 run osmo-hlr_10.42.42.2(pid=28221): Launched 10:21:06.308722 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:06.825348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28223): Launched 10:21:07.124149 run osmo-stp_10.42.42.5(pid=28224): Launched 10:21:07.237481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:07.751092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28226): Launched 10:21:07.865637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:08.116674 run patchelf(pid=28227): Launched 10:21:08.283130 run osmo-stp_10.42.42.5(pid=28224): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28224)] 10:21:08.409350 run osmo-stp_10.42.42.5(pid=28224): stdout: | (launched: 2022-12-10_10:21:07.069318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:08.537556 run osmo-stp_10.42.42.5(pid=28224): stderr: | 20221210102107239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102107239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102107239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102107240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102107240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102107240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102107240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:08.666415 run osmo-stp_10.42.42.5(pid=28224): stdout: | (launched: 2022-12-10_10:21:07.069318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:08.788509 run osmo-stp_10.42.42.5(pid=28224): stderr: | 20221210102107239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102107239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102107239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102107240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102107240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102107240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102107240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:08.933175 run patchelf(pid=28227): Terminating (SIGINT) 10:21:09.101405 run patchelf(pid=28227): Terminated: ok {rc=0} 10:21:09.222624 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28224): Process ended prematurely: osmo-stp_10.42.42.5(pid=28224) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28224)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 10:21:09.231283 tst ping.py:22: Test FAILED (6.4 sec) 10:21:09.257995 run osmo-hlr_10.42.42.2(pid=28221): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28221)] 10:21:09.305458 run osmo-hlr_10.42.42.2(pid=28221): stdout: | (launched: 2022-12-10_10:21:06.140451) 10:21:09.354817 run osmo-hlr_10.42.42.2(pid=28221): stderr: | 20221210102106313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102106313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102106313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102106313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102106313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102106313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102106326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102106336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102106337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102106337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:09.404308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28220): Terminating (SIGTERM) 10:21:09.444324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28223): Terminating (SIGTERM) 10:21:09.484145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28226): Terminating (SIGTERM) 10:21:09.524216 --- ParallelTerminationStrategy: PID 28220 died... 10:21:09.543480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28220): Terminated: ok {rc=0} 10:21:09.587797 --- ParallelTerminationStrategy: PID 28223 died... 10:21:09.606495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28223): Terminated: ok {rc=0} 10:21:09.650659 --- ParallelTerminationStrategy: PID 28226 died... 10:21:09.669286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28226): Terminated: ok {rc=0} 10:21:09.752884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:21:10.840255 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:10.853108 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:21:10.908734 tst ping_idle_ping.py: using LAC 27721 10:21:11.035118 tst ping_idle_ping.py: using RAC 181 10:21:11.161204 tst ping_idle_ping.py: using CellId 27721 10:21:11.285269 tst ping_idle_ping.py: using BVCI 27722 10:21:11.402512 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:11.414150 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:11.425643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:11.437326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:11.448713 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:11.460193 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:11.472065 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:21:11.483606 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:21:11.599531 tst ping_idle_ping.py:24: start network... 10:21:11.800473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:12.264901 run create_hlr_db(pid=28228): Launched 10:21:12.387919 bus /gobi_6: Setting Powered False 10:21:13.448832 run create_hlr_db(pid=28228): Terminated: ok {rc=0} 10:21:13.886468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28230): Launched 10:21:14.206977 run osmo-hlr_10.42.42.2(pid=28231): Launched 10:21:14.330002 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:14.882113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28233): Launched 10:21:15.201660 run osmo-stp_10.42.42.5(pid=28234): Launched 10:21:15.324235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:15.903232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28236): Launched 10:21:16.040626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:16.321421 run patchelf(pid=28237): Launched 10:21:16.515261 run osmo-stp_10.42.42.5(pid=28234): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28234)] 10:21:16.655060 run osmo-stp_10.42.42.5(pid=28234): stdout: | (launched: 2022-12-10_10:21:15.144170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:16.796099 run osmo-stp_10.42.42.5(pid=28234): stderr: | 20221210102115336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102115336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102115337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102115337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102115337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102115337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102115337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:16.937232 run osmo-stp_10.42.42.5(pid=28234): stdout: | (launched: 2022-12-10_10:21:15.144170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:17.072037 run osmo-stp_10.42.42.5(pid=28234): stderr: | 20221210102115336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102115336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102115337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102115337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102115337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102115337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102115337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:17.230882 run patchelf(pid=28237): Terminating (SIGINT) 10:21:17.410610 run patchelf(pid=28237): Terminated: ok {rc=0} 10:21:17.541214 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28234): Process ended prematurely: osmo-stp_10.42.42.5(pid=28234) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28234)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 10:21:17.550875 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:21:17.580374 run osmo-hlr_10.42.42.2(pid=28231): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28231)] 10:21:17.631162 run osmo-hlr_10.42.42.2(pid=28231): stdout: | (launched: 2022-12-10_10:21:14.149353) 10:21:17.683564 run osmo-hlr_10.42.42.2(pid=28231): stderr: | 20221210102114347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102114347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102114347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102114347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102114347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102114347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102114359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102114367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102114367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102114367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:17.736350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28230): Terminating (SIGTERM) 10:21:17.778941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28233): Terminating (SIGTERM) 10:21:17.821445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28236): Terminating (SIGTERM) 10:21:17.864163 --- ParallelTerminationStrategy: PID 28230 died... 10:21:17.884225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28230): Terminated: ok {rc=0} 10:21:17.931389 --- ParallelTerminationStrategy: PID 28233 died... 10:21:17.951071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28233): Terminated: ok {rc=0} 10:21:17.997900 --- ParallelTerminationStrategy: PID 28236 died... 10:21:18.017620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28236): Terminated: ok {rc=0} 10:21:18.106651 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:21:19.427294 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:21:19.433942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:21:19.470677 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:21:19.510666 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:21:19.598468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:21:19.633339 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:21:19.673438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:21:20.273379 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:21:20.326270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.337785 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:21:20.409655 tst cs_paging_gprs_active.py: using LAC 27722 10:21:20.536934 tst cs_paging_gprs_active.py: using RAC 182 10:21:20.660804 tst cs_paging_gprs_active.py: using CellId 27722 10:21:20.788175 tst cs_paging_gprs_active.py: using BVCI 27723 10:21:20.905510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.916844 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.928122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.939636 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.951193 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.962616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.974506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.985859 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:20.997655 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:21.113442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:21.230602 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:21:21.433968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:21.737710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28243): Launched 10:21:22.001939 run iperf3-srv_10.42.42.10(pid=28244): Launched 10:21:22.115539 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:21:22.319154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:22.622710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28245): Launched 10:21:22.887727 run iperf3-srv_10.42.42.10(pid=28246): Launched 10:21:23.001163 tst cs_paging_gprs_active.py:38: start network... 10:21:23.204054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:23.673868 run create_hlr_db(pid=28247): Launched 10:21:23.798825 bus /gobi_6: Setting Powered False 10:21:24.858969 run create_hlr_db(pid=28247): Terminated: ok {rc=0} 10:21:25.303156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28249): Launched 10:21:25.627356 run osmo-hlr_10.42.42.2(pid=28250): Launched 10:21:25.752621 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:26.314481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28252): Launched 10:21:26.637912 run osmo-stp_10.42.42.5(pid=28253): Launched 10:21:26.762779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:27.321600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28255): Launched 10:21:27.439918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:27.697134 run patchelf(pid=28256): Launched 10:21:27.866752 run osmo-stp_10.42.42.5(pid=28253): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28253)] 10:21:27.995301 run osmo-stp_10.42.42.5(pid=28253): stdout: | (launched: 2022-12-10_10:21:26.579832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:28.125509 run osmo-stp_10.42.42.5(pid=28253): stderr: | 20221210102126771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102126771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102126772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102126772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102126774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102126774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102126775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:28.255694 run osmo-stp_10.42.42.5(pid=28253): stdout: | (launched: 2022-12-10_10:21:26.579832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:28.379833 run osmo-stp_10.42.42.5(pid=28253): stderr: | 20221210102126771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102126771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102126772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102126772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102126774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102126774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102126775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:28.526921 run patchelf(pid=28256): Terminating (SIGINT) 10:21:28.697603 run patchelf(pid=28256): Terminated: ok {rc=0} 10:21:28.821531 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28253): Process ended prematurely: osmo-stp_10.42.42.5(pid=28253) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28253)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:21:28.830854 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:21:28.858072 run osmo-hlr_10.42.42.2(pid=28250): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28250)] 10:21:28.905925 run osmo-hlr_10.42.42.2(pid=28250): stdout: | (launched: 2022-12-10_10:21:25.569297) 10:21:28.955187 run osmo-hlr_10.42.42.2(pid=28250): stderr: | 20221210102125766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102125766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102125766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102125766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102125766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102125766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102125779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102125789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102125789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102125789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:29.004898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28243): Terminating (SIGTERM) 10:21:29.044763 run iperf3-srv_10.42.42.10(pid=28244): Terminating (SIGTERM) 10:21:29.084409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28245): Terminating (SIGTERM) 10:21:29.124178 run iperf3-srv_10.42.42.10(pid=28246): Terminating (SIGTERM) 10:21:29.163486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28249): Terminating (SIGTERM) 10:21:29.202673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28252): Terminating (SIGTERM) 10:21:29.242199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28255): Terminating (SIGTERM) 10:21:29.281849 --- ParallelTerminationStrategy: PID 28243 died... 10:21:29.300590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28243): Terminated: ok {rc=0} 10:21:29.344174 --- ParallelTerminationStrategy: PID 28244 died... 10:21:29.362558 run iperf3-srv_10.42.42.10(pid=28244): Terminated {rc=256} 10:21:29.405805 --- ParallelTerminationStrategy: PID 28245 died... 10:21:29.424012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28245): Terminated: ok {rc=0} 10:21:29.467932 --- ParallelTerminationStrategy: PID 28246 died... 10:21:29.486312 run iperf3-srv_10.42.42.10(pid=28246): Terminated {rc=256} 10:21:29.529497 --- ParallelTerminationStrategy: PID 28249 died... 10:21:29.547762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28249): Terminated: ok {rc=0} 10:21:29.591140 --- ParallelTerminationStrategy: PID 28252 died... 10:21:29.609566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28252): Terminated: ok {rc=0} 10:21:29.652879 --- ParallelTerminationStrategy: PID 28255 died... 10:21:29.671728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28255): Terminated: ok {rc=0} 10:21:29.756425 bus /gobi_0: Setting Powered False 10:21:30.873080 bus /gobi_0: Setting Powered False 10:21:31.998207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:21:33.147730 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.159425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:21:33.232756 tst iperf3.py: using LAC 27723 10:21:33.351639 tst iperf3.py: using RAC 183 10:21:33.472349 tst iperf3.py: using CellId 27723 10:21:33.592829 tst iperf3.py: using BVCI 27724 10:21:33.704340 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.715467 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.726258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.737078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.747816 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.758655 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.769521 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.780168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:33.791035 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:33.907180 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:21:34.110903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:34.414526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Launched 10:21:34.677896 run iperf3-srv_10.42.42.10(pid=28258): Launched 10:21:34.793149 tst iperf3.py:8: start network... 10:21:34.997305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:35.469031 run create_hlr_db(pid=28259): Launched 10:21:35.593202 bus /gobi_6: Setting Powered False 10:21:36.654258 run create_hlr_db(pid=28259): Terminated: ok {rc=0} 10:21:37.097117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28261): Launched 10:21:37.421073 run osmo-hlr_10.42.42.2(pid=28262): Launched 10:21:37.547088 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:38.110901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28264): Launched 10:21:38.434008 run osmo-stp_10.42.42.5(pid=28265): Launched 10:21:38.559011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:39.120660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28267): Launched 10:21:39.245961 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:39.518790 run patchelf(pid=28268): Launched 10:21:39.700141 run osmo-stp_10.42.42.5(pid=28265): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28265)] 10:21:39.838680 run osmo-stp_10.42.42.5(pid=28265): stdout: | (launched: 2022-12-10_10:21:38.375967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:39.978091 run osmo-stp_10.42.42.5(pid=28265): stderr: | 20221210102138566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102138566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102138566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102138567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102138567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102138567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102138567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:40.117914 run osmo-stp_10.42.42.5(pid=28265): stdout: | (launched: 2022-12-10_10:21:38.375967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:40.251007 run osmo-stp_10.42.42.5(pid=28265): stderr: | 20221210102138566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102138566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102138566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102138567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102138567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102138567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102138567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:40.408347 run patchelf(pid=28268): Terminating (SIGINT) 10:21:40.590935 run patchelf(pid=28268): Terminated: ok {rc=0} 10:21:40.722620 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28265): Process ended prematurely: osmo-stp_10.42.42.5(pid=28265) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28265)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 10:21:40.732645 tst iperf3.py:8: Test FAILED (7.6 sec) 10:21:40.761784 run osmo-hlr_10.42.42.2(pid=28262): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28262)] 10:21:40.811899 run osmo-hlr_10.42.42.2(pid=28262): stdout: | (launched: 2022-12-10_10:21:37.362924) 10:21:40.864078 run osmo-hlr_10.42.42.2(pid=28262): stderr: | 20221210102137561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102137561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102137561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102137561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102137561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102137561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102137575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102137585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102137586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102137586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:40.916611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Terminating (SIGTERM) 10:21:40.958638 run iperf3-srv_10.42.42.10(pid=28258): Terminating (SIGTERM) 10:21:41.000674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28261): Terminating (SIGTERM) 10:21:41.043150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28264): Terminating (SIGTERM) 10:21:41.085236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28267): Terminating (SIGTERM) 10:21:41.127619 --- ParallelTerminationStrategy: PID 28257 died... 10:21:41.147434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28257): Terminated: ok {rc=0} 10:21:41.194105 --- ParallelTerminationStrategy: PID 28258 died... 10:21:41.213423 run iperf3-srv_10.42.42.10(pid=28258): Terminated {rc=256} 10:21:41.259776 --- ParallelTerminationStrategy: PID 28261 died... 10:21:41.279289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28261): Terminated: ok {rc=0} 10:21:41.325697 --- ParallelTerminationStrategy: PID 28264 died... 10:21:41.345211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28264): Terminated: ok {rc=0} 10:21:41.391681 --- ParallelTerminationStrategy: PID 28267 died... 10:21:41.411240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28267): Terminated: ok {rc=0} 10:21:41.499014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:21:42.650718 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:42.663018 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:21:42.740628 tst iperf3m4.py: using LAC 27724 10:21:42.860212 tst iperf3m4.py: using RAC 184 10:21:42.987239 tst iperf3m4.py: using CellId 27724 10:21:43.112197 tst iperf3m4.py: using BVCI 27725 10:21:43.229685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.241540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.252769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.264354 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.275823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.287819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.299408 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.310870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:21:43.322564 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:43.438263 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:43.559248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:43.679384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:21:43.800210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:21:44.020169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:44.345056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28269): Launched 10:21:44.627534 run iperf3-srv_10.42.42.10(pid=28270): Launched 10:21:44.749828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:21:44.968921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:45.294380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28271): Launched 10:21:45.577177 run iperf3-srv_10.42.42.10(pid=28272): Launched 10:21:45.698900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:21:45.927770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:46.273807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28273): Launched 10:21:46.570037 run iperf3-srv_10.42.42.10(pid=28274): Launched 10:21:46.693473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:21:46.904038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:21:47.229719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28275): Launched 10:21:47.523973 run iperf3-srv_10.42.42.10(pid=28276): Launched 10:21:47.646049 tst iperf3m4.py:8: start network... 10:21:47.864772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:21:48.367031 run create_hlr_db(pid=28277): Launched 10:21:48.491479 bus /gobi_6: Setting Powered False 10:21:49.555644 run create_hlr_db(pid=28277): Terminated: ok {rc=0} 10:21:49.990991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28279): Launched 10:21:50.295761 run osmo-hlr_10.42.42.2(pid=28280): Launched 10:21:50.412497 run osmo-stp_10.42.42.5: Starting osmo-stp 10:21:50.937439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28282): Launched 10:21:51.242323 run osmo-stp_10.42.42.5(pid=28283): Launched 10:21:51.358336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:21:51.882887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28285): Launched 10:21:51.999491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:21:52.256342 run patchelf(pid=28286): Launched 10:21:52.425932 run osmo-stp_10.42.42.5(pid=28283): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28283)] 10:21:52.554882 run osmo-stp_10.42.42.5(pid=28283): stdout: | (launched: 2022-12-10_10:21:51.186941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:52.685667 run osmo-stp_10.42.42.5(pid=28283): stderr: | 20221210102151359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102151360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102151360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102151360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102151361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102151361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102151361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:52.816135 run osmo-stp_10.42.42.5(pid=28283): stdout: | (launched: 2022-12-10_10:21:51.186941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:21:52.941134 run osmo-stp_10.42.42.5(pid=28283): stderr: | 20221210102151359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102151360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102151360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102151360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102151361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102151361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102151361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:21:53.088337 run patchelf(pid=28286): Terminating (SIGINT) 10:21:53.258801 run patchelf(pid=28286): Terminated: ok {rc=0} 10:21:53.381575 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28283): Process ended prematurely: osmo-stp_10.42.42.5(pid=28283) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28283)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:21:53.390979 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:21:53.418461 run osmo-hlr_10.42.42.2(pid=28280): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28280)] 10:21:53.466151 run osmo-hlr_10.42.42.2(pid=28280): stdout: | (launched: 2022-12-10_10:21:50.240330) 10:21:53.515471 run osmo-hlr_10.42.42.2(pid=28280): stderr: | 20221210102150416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102150416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102150416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102150416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102150416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102150416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102150429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102150438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102150438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102150438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:21:53.565273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28269): Terminating (SIGTERM) 10:21:53.605398 run iperf3-srv_10.42.42.10(pid=28270): Terminating (SIGTERM) 10:21:53.645505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28271): Terminating (SIGTERM) 10:21:53.685453 run iperf3-srv_10.42.42.10(pid=28272): Terminating (SIGTERM) 10:21:53.725261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28273): Terminating (SIGTERM) 10:21:53.765821 run iperf3-srv_10.42.42.10(pid=28274): Terminating (SIGTERM) 10:21:53.805768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28275): Terminating (SIGTERM) 10:21:53.845616 run iperf3-srv_10.42.42.10(pid=28276): Terminating (SIGTERM) 10:21:53.885421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28279): Terminating (SIGTERM) 10:21:53.925369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28282): Terminating (SIGTERM) 10:21:53.965060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28285): Terminating (SIGTERM) 10:21:54.005068 --- ParallelTerminationStrategy: PID 28269 died... 10:21:54.024070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28269): Terminated: ok {rc=0} 10:21:54.068838 --- ParallelTerminationStrategy: PID 28270 died... 10:21:54.087457 run iperf3-srv_10.42.42.10(pid=28270): Terminated {rc=256} 10:21:54.131131 --- ParallelTerminationStrategy: PID 28271 died... 10:21:54.149665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28271): Terminated: ok {rc=0} 10:21:54.193641 --- ParallelTerminationStrategy: PID 28272 died... 10:21:54.212105 run iperf3-srv_10.42.42.10(pid=28272): Terminated {rc=256} 10:21:54.256036 --- ParallelTerminationStrategy: PID 28273 died... 10:21:54.274756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28273): Terminated: ok {rc=0} 10:21:54.319106 --- ParallelTerminationStrategy: PID 28274 died... 10:21:54.337556 run iperf3-srv_10.42.42.10(pid=28274): Terminated {rc=256} 10:21:54.380921 --- ParallelTerminationStrategy: PID 28275 died... 10:21:54.399880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28275): Terminated: ok {rc=0} 10:21:54.443497 --- ParallelTerminationStrategy: PID 28276 died... 10:21:54.462017 run iperf3-srv_10.42.42.10(pid=28276): Terminated {rc=256} 10:21:54.505336 --- ParallelTerminationStrategy: PID 28279 died... 10:21:54.523770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28279): Terminated: ok {rc=0} 10:21:54.567943 --- ParallelTerminationStrategy: PID 28282 died... 10:21:54.586429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28282): Terminated: ok {rc=0} 10:21:54.629958 --- ParallelTerminationStrategy: PID 28285 died... 10:21:54.648387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28285): Terminated: ok {rc=0} 10:21:54.733322 bus /gobi_4: Setting Powered False 10:21:55.832686 bus /gobi_4: Setting Powered False 10:21:56.948249 bus /gobi_1: Setting Powered False 10:21:58.047258 bus /gobi_1: Setting Powered False 10:21:59.163230 bus /gobi_0: Setting Powered False 10:22:00.261236 bus /gobi_0: Setting Powered False 10:22:01.372201 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:22:02.473265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:02.485333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:22:02.558403 tst ping.py: using LAC 27725 10:22:02.684321 tst ping.py: using RAC 185 10:22:02.814092 tst ping.py: using CellId 27725 10:22:02.938787 tst ping.py: using BVCI 27726 10:22:03.055518 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:03.067138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:03.078686 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:03.090375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:03.101950 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:03.113972 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:03.125422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:03.136858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:22:03.255449 tst ping.py:19: start network... 10:22:03.469817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:03.960938 run create_hlr_db(pid=28287): Launched 10:22:04.083043 bus /gobi_6: Setting Powered False 10:22:05.146197 run create_hlr_db(pid=28287): Terminated: ok {rc=0} 10:22:05.589585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Launched 10:22:05.907688 run osmo-hlr_10.42.42.2(pid=28290): Launched 10:22:06.029860 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:06.577781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Launched 10:22:06.897114 run osmo-stp_10.42.42.5(pid=28293): Launched 10:22:07.019364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:07.569141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28295): Launched 10:22:07.691137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:07.958251 run patchelf(pid=28296): Launched 10:22:08.135405 run osmo-stp_10.42.42.5(pid=28293): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] 10:22:08.270038 run osmo-stp_10.42.42.5(pid=28293): stdout: | (launched: 2022-12-10_10:22:06.839563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:08.406691 run osmo-stp_10.42.42.5(pid=28293): stderr: | 20221210102207029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102207029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102207029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102207030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102207030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102207030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102207030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:08.543391 run osmo-stp_10.42.42.5(pid=28293): stdout: | (launched: 2022-12-10_10:22:06.839563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:08.673620 run osmo-stp_10.42.42.5(pid=28293): stderr: | 20221210102207029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102207029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102207029 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102207030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102207030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102207030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102207030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:08.828038 run patchelf(pid=28296): Terminating (SIGINT) 10:22:09.006291 run patchelf(pid=28296): Terminated: ok {rc=0} 10:22:09.135976 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28293): Process ended prematurely: osmo-stp_10.42.42.5(pid=28293) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 10:22:09.145532 tst ping.py:22: Test FAILED (6.7 sec) 10:22:09.174967 run osmo-hlr_10.42.42.2(pid=28290): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28290)] 10:22:09.225501 run osmo-hlr_10.42.42.2(pid=28290): stdout: | (launched: 2022-12-10_10:22:05.850553) 10:22:09.278032 run osmo-hlr_10.42.42.2(pid=28290): stderr: | 20221210102206049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102206049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102206049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102206049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102206049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102206049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102206082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102206092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102206092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102206092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:09.331112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Terminating (SIGTERM) 10:22:09.373718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Terminating (SIGTERM) 10:22:09.416172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28295): Terminating (SIGTERM) 10:22:09.458746 --- ParallelTerminationStrategy: PID 28289 died... 10:22:09.478803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28289): Terminated: ok {rc=0} 10:22:09.525702 --- ParallelTerminationStrategy: PID 28292 died... 10:22:09.545411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28292): Terminated: ok {rc=0} 10:22:09.592279 --- ParallelTerminationStrategy: PID 28295 died... 10:22:09.612008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28295): Terminated: ok {rc=0} 10:22:09.701074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:22:10.789801 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:10.802595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:22:10.878348 tst ping_idle_ping.py: using LAC 27726 10:22:11.005180 tst ping_idle_ping.py: using RAC 186 10:22:11.130113 tst ping_idle_ping.py: using CellId 27726 10:22:11.254779 tst ping_idle_ping.py: using BVCI 27727 10:22:11.370653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:11.382491 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:11.393791 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:11.405418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:11.416774 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:11.428331 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:11.439947 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:22:11.451470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:22:11.567474 tst ping_idle_ping.py:24: start network... 10:22:11.769008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:12.239668 run create_hlr_db(pid=28297): Launched 10:22:12.362909 bus /gobi_6: Setting Powered False 10:22:13.423097 run create_hlr_db(pid=28297): Terminated: ok {rc=0} 10:22:13.861162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28299): Launched 10:22:14.181784 run osmo-hlr_10.42.42.2(pid=28300): Launched 10:22:14.304016 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:14.855747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28302): Launched 10:22:15.174524 run osmo-stp_10.42.42.5(pid=28303): Launched 10:22:15.296398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:15.853766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28305): Launched 10:22:15.990869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:16.281776 run patchelf(pid=28306): Launched 10:22:16.469338 run osmo-stp_10.42.42.5(pid=28303): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28303)] 10:22:16.608309 run osmo-stp_10.42.42.5(pid=28303): stdout: | (launched: 2022-12-10_10:22:15.117281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:16.757723 run osmo-stp_10.42.42.5(pid=28303): stderr: | 20221210102215308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102215308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102215308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102215309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102215309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102215309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102215309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:16.925308 run osmo-stp_10.42.42.5(pid=28303): stdout: | (launched: 2022-12-10_10:22:15.117281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:17.063444 run osmo-stp_10.42.42.5(pid=28303): stderr: | 20221210102215308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102215308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102215308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102215309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102215309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102215309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102215309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:17.224187 run patchelf(pid=28306): Terminating (SIGINT) 10:22:17.403769 run patchelf(pid=28306): Terminated: ok {rc=0} 10:22:17.533496 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28303): Process ended prematurely: osmo-stp_10.42.42.5(pid=28303) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28303)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:22:17.543431 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:22:17.573723 run osmo-hlr_10.42.42.2(pid=28300): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28300)] 10:22:17.625077 run osmo-hlr_10.42.42.2(pid=28300): stdout: | (launched: 2022-12-10_10:22:14.124318) 10:22:17.678072 run osmo-hlr_10.42.42.2(pid=28300): stderr: | 20221210102214320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102214320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102214320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102214320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102214320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102214320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102214333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102214341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102214342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102214342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:17.731634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28299): Terminating (SIGTERM) 10:22:17.774818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28302): Terminating (SIGTERM) 10:22:17.818099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28305): Terminating (SIGTERM) 10:22:17.861540 --- ParallelTerminationStrategy: PID 28299 died... 10:22:17.881718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28299): Terminated: ok {rc=0} 10:22:17.929762 --- ParallelTerminationStrategy: PID 28302 died... 10:22:17.949496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28302): Terminated: ok {rc=0} 10:22:17.997660 --- ParallelTerminationStrategy: PID 28305 died... 10:22:18.017309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28305): Terminated: ok {rc=0} 10:22:18.107460 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:22:19.416857 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:22:19.423815 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:22:19.459547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:22:19.499370 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:22:19.588524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:22:19.624073 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:22:19.663643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:22:20.265120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:22:20.317831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.329737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:22:20.401673 tst cs_paging_gprs_active.py: using LAC 27727 10:22:20.528012 tst cs_paging_gprs_active.py: using RAC 187 10:22:20.655153 tst cs_paging_gprs_active.py: using CellId 27727 10:22:20.781369 tst cs_paging_gprs_active.py: using BVCI 27728 10:22:20.899727 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.911396 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.922937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.934748 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.946455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.958198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.970458 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.982315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:20.994109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:21.117136 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:21.238406 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:22:21.458652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:21.783761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Launched 10:22:22.067467 run iperf3-srv_10.42.42.10(pid=28311): Launched 10:22:22.190359 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:22:22.410627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:22.736561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28312): Launched 10:22:23.018139 run iperf3-srv_10.42.42.10(pid=28313): Launched 10:22:23.141429 tst cs_paging_gprs_active.py:38: start network... 10:22:23.361437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:23.863751 run create_hlr_db(pid=28314): Launched 10:22:23.987702 bus /gobi_6: Setting Powered False 10:22:25.050755 run create_hlr_db(pid=28314): Terminated: ok {rc=0} 10:22:25.485241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28316): Launched 10:22:25.788815 run osmo-hlr_10.42.42.2(pid=28317): Launched 10:22:25.904521 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:26.444419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28319): Launched 10:22:26.748139 run osmo-stp_10.42.42.5(pid=28321): Launched 10:22:26.863971 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:27.388904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28323): Launched 10:22:27.505467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:27.761503 run patchelf(pid=28324): Launched 10:22:27.931816 run osmo-stp_10.42.42.5(pid=28321): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28321)] 10:22:28.060770 run osmo-stp_10.42.42.5(pid=28321): stdout: | (launched: 2022-12-10_10:22:26.692940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:28.190805 run osmo-stp_10.42.42.5(pid=28321): stderr: | 20221210102226865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102226866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102226866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102226866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102226867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102226867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102226867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:28.321353 run osmo-stp_10.42.42.5(pid=28321): stdout: | (launched: 2022-12-10_10:22:26.692940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:28.446167 run osmo-stp_10.42.42.5(pid=28321): stderr: | 20221210102226865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102226866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102226866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102226866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102226867 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102226867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102226867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:28.594102 run patchelf(pid=28324): Terminating (SIGINT) 10:22:28.765841 run patchelf(pid=28324): Terminated: ok {rc=0} 10:22:28.889885 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28321): Process ended prematurely: osmo-stp_10.42.42.5(pid=28321) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28321)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:22:28.899292 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:22:28.926391 run osmo-hlr_10.42.42.2(pid=28317): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28317)] 10:22:28.973588 run osmo-hlr_10.42.42.2(pid=28317): stdout: | (launched: 2022-12-10_10:22:25.734211) 10:22:29.022519 run osmo-hlr_10.42.42.2(pid=28317): stderr: | 20221210102225912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102225912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102225912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102225912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102225912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102225912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102225925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102225934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102225934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102225934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:29.071892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Terminating (SIGTERM) 10:22:29.111481 run iperf3-srv_10.42.42.10(pid=28311): Terminating (SIGTERM) 10:22:29.151012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28312): Terminating (SIGTERM) 10:22:29.190487 run iperf3-srv_10.42.42.10(pid=28313): Terminating (SIGTERM) 10:22:29.230552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28316): Terminating (SIGTERM) 10:22:29.270081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28319): Terminating (SIGTERM) 10:22:29.309504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28323): Terminating (SIGTERM) 10:22:29.349210 --- ParallelTerminationStrategy: PID 28310 died... 10:22:29.367986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Terminated: ok {rc=0} 10:22:29.411658 --- ParallelTerminationStrategy: PID 28311 died... 10:22:29.430171 run iperf3-srv_10.42.42.10(pid=28311): Terminated {rc=256} 10:22:29.474009 --- ParallelTerminationStrategy: PID 28312 died... 10:22:29.492421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28312): Terminated: ok {rc=0} 10:22:29.536498 --- ParallelTerminationStrategy: PID 28313 died... 10:22:29.554915 run iperf3-srv_10.42.42.10(pid=28313): Terminated {rc=256} 10:22:29.598434 --- ParallelTerminationStrategy: PID 28316 died... 10:22:29.616882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28316): Terminated: ok {rc=0} 10:22:29.660559 --- ParallelTerminationStrategy: PID 28319 died... 10:22:29.679093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28319): Terminated: ok {rc=0} 10:22:29.722528 --- ParallelTerminationStrategy: PID 28323 died... 10:22:29.741007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28323): Terminated: ok {rc=0} 10:22:29.823576 bus /gobi_0: Setting Powered False 10:22:30.942893 bus /gobi_0: Setting Powered False 10:22:32.067825 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:22:33.220090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.232076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:22:33.306311 tst iperf3.py: using LAC 27728 10:22:33.427583 tst iperf3.py: using RAC 188 10:22:33.548180 tst iperf3.py: using CellId 27728 10:22:33.667346 tst iperf3.py: using BVCI 27729 10:22:33.787616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.799332 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.810934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.823143 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.834955 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.846819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.858800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.870725 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:33.882914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:33.999483 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:22:34.204366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:34.508515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28325): Launched 10:22:34.775399 run iperf3-srv_10.42.42.10(pid=28326): Launched 10:22:34.890675 tst iperf3.py:8: start network... 10:22:35.095739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:35.568486 run create_hlr_db(pid=28327): Launched 10:22:35.694003 bus /gobi_6: Setting Powered False 10:22:36.754671 run create_hlr_db(pid=28327): Terminated: ok {rc=0} 10:22:37.176455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28330): Launched 10:22:37.479695 run osmo-hlr_10.42.42.2(pid=28331): Launched 10:22:37.595905 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:38.117692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28333): Launched 10:22:38.421357 run osmo-stp_10.42.42.5(pid=28334): Launched 10:22:38.537653 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:39.061663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28336): Launched 10:22:39.178616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:39.436423 run patchelf(pid=28337): Launched 10:22:39.605862 run osmo-stp_10.42.42.5(pid=28334): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28334)] 10:22:39.734910 run osmo-stp_10.42.42.5(pid=28334): stdout: | (launched: 2022-12-10_10:22:38.366138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:39.865249 run osmo-stp_10.42.42.5(pid=28334): stderr: | 20221210102238537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102238537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102238537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102238538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102238538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102238538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102238538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:39.995888 run osmo-stp_10.42.42.5(pid=28334): stdout: | (launched: 2022-12-10_10:22:38.366138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:40.120408 run osmo-stp_10.42.42.5(pid=28334): stderr: | 20221210102238537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102238537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102238537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102238538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102238538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102238538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102238538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:40.267971 run patchelf(pid=28337): Terminating (SIGINT) 10:22:40.439100 run patchelf(pid=28337): Terminated: ok {rc=0} 10:22:40.562046 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28334): Process ended prematurely: osmo-stp_10.42.42.5(pid=28334) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28334)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 10:22:40.571264 tst iperf3.py:8: Test FAILED (7.4 sec) 10:22:40.598557 run osmo-hlr_10.42.42.2(pid=28331): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28331)] 10:22:40.646239 run osmo-hlr_10.42.42.2(pid=28331): stdout: | (launched: 2022-12-10_10:22:37.425063) 10:22:40.695778 run osmo-hlr_10.42.42.2(pid=28331): stderr: | 20221210102237601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102237601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102237601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102237601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102237601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102237601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102237614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102237622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102237623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102237623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:40.745711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28325): Terminating (SIGTERM) 10:22:40.785642 run iperf3-srv_10.42.42.10(pid=28326): Terminating (SIGTERM) 10:22:40.825408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28330): Terminating (SIGTERM) 10:22:40.865121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28333): Terminating (SIGTERM) 10:22:40.904679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28336): Terminating (SIGTERM) 10:22:40.944722 --- ParallelTerminationStrategy: PID 28325 died... 10:22:40.963787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28325): Terminated: ok {rc=0} 10:22:41.007746 --- ParallelTerminationStrategy: PID 28326 died... 10:22:41.026352 run iperf3-srv_10.42.42.10(pid=28326): Terminated {rc=256} 10:22:41.070429 --- ParallelTerminationStrategy: PID 28330 died... 10:22:41.089023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28330): Terminated: ok {rc=0} 10:22:41.132791 --- ParallelTerminationStrategy: PID 28333 died... 10:22:41.151433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28333): Terminated: ok {rc=0} 10:22:41.195093 --- ParallelTerminationStrategy: PID 28336 died... 10:22:41.213584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28336): Terminated: ok {rc=0} 10:22:41.299661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:22:42.448430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:42.459968 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:22:42.531665 tst iperf3m4.py: using LAC 27729 10:22:42.650587 tst iperf3m4.py: using RAC 189 10:22:42.771965 tst iperf3m4.py: using CellId 27729 10:22:42.892576 tst iperf3m4.py: using BVCI 27730 10:22:43.002808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.013866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.024591 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.035516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.046334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.057114 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.068335 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.079123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:22:43.090210 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:43.204392 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:43.325710 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:43.443762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:22:43.560328 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:22:43.764073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:44.068319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28338): Launched 10:22:44.334031 run iperf3-srv_10.42.42.10(pid=28339): Launched 10:22:44.448675 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:22:44.652423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:44.957120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28340): Launched 10:22:45.222111 run iperf3-srv_10.42.42.10(pid=28341): Launched 10:22:45.336639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:22:45.539512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:45.854297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28342): Launched 10:22:46.162595 run iperf3-srv_10.42.42.10(pid=28343): Launched 10:22:46.287504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:22:46.497835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:22:46.821770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28344): Launched 10:22:47.105760 run iperf3-srv_10.42.42.10(pid=28345): Launched 10:22:47.231653 tst iperf3m4.py:8: start network... 10:22:47.436045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:22:47.906337 run create_hlr_db(pid=28346): Launched 10:22:48.030538 bus /gobi_6: Setting Powered False 10:22:49.091041 run create_hlr_db(pid=28346): Terminated: ok {rc=0} 10:22:49.533208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28348): Launched 10:22:49.856785 run osmo-hlr_10.42.42.2(pid=28349): Launched 10:22:49.982387 run osmo-stp_10.42.42.5: Starting osmo-stp 10:22:50.545732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28351): Launched 10:22:50.869702 run osmo-stp_10.42.42.5(pid=28352): Launched 10:22:50.994052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:22:51.555155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28354): Launched 10:22:51.679924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:22:51.952629 run patchelf(pid=28355): Launched 10:22:52.134385 run osmo-stp_10.42.42.5(pid=28352): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28352)] 10:22:52.271343 run osmo-stp_10.42.42.5(pid=28352): stdout: | (launched: 2022-12-10_10:22:50.811431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:52.410494 run osmo-stp_10.42.42.5(pid=28352): stderr: | 20221210102251004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102251004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102251004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102251005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102251005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102251005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102251005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:52.549249 run osmo-stp_10.42.42.5(pid=28352): stdout: | (launched: 2022-12-10_10:22:50.811431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:22:52.681752 run osmo-stp_10.42.42.5(pid=28352): stderr: | 20221210102251004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102251004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102251004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102251005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102251005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102251005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102251005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:22:52.838875 run patchelf(pid=28355): Terminating (SIGINT) 10:22:53.020197 run patchelf(pid=28355): Terminated: ok {rc=0} 10:22:53.151911 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28352): Process ended prematurely: osmo-stp_10.42.42.5(pid=28352) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28352)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:22:53.162219 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:22:53.191423 run osmo-hlr_10.42.42.2(pid=28349): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28349)] 10:22:53.241583 run osmo-hlr_10.42.42.2(pid=28349): stdout: | (launched: 2022-12-10_10:22:49.798586) 10:22:53.293546 run osmo-hlr_10.42.42.2(pid=28349): stderr: | 20221210102249998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102249998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102249998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102249998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102249998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102249998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102250011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102250021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102250021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102250021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:22:53.345840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28338): Terminating (SIGTERM) 10:22:53.388054 run iperf3-srv_10.42.42.10(pid=28339): Terminating (SIGTERM) 10:22:53.430394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28340): Terminating (SIGTERM) 10:22:53.472487 run iperf3-srv_10.42.42.10(pid=28341): Terminating (SIGTERM) 10:22:53.514476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28342): Terminating (SIGTERM) 10:22:53.556321 run iperf3-srv_10.42.42.10(pid=28343): Terminating (SIGTERM) 10:22:53.598285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28344): Terminating (SIGTERM) 10:22:53.640404 run iperf3-srv_10.42.42.10(pid=28345): Terminating (SIGTERM) 10:22:53.682362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28348): Terminating (SIGTERM) 10:22:53.724405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28351): Terminating (SIGTERM) 10:22:53.766453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28354): Terminating (SIGTERM) 10:22:53.808575 --- ParallelTerminationStrategy: PID 28338 died... 10:22:53.828508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28338): Terminated: ok {rc=0} 10:22:53.875719 --- ParallelTerminationStrategy: PID 28339 died... 10:22:53.895334 run iperf3-srv_10.42.42.10(pid=28339): Terminated {rc=256} 10:22:53.941960 --- ParallelTerminationStrategy: PID 28340 died... 10:22:53.961602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28340): Terminated: ok {rc=0} 10:22:54.008608 --- ParallelTerminationStrategy: PID 28341 died... 10:22:54.028294 run iperf3-srv_10.42.42.10(pid=28341): Terminated {rc=256} 10:22:54.075686 --- ParallelTerminationStrategy: PID 28342 died... 10:22:54.095415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28342): Terminated: ok {rc=0} 10:22:54.142460 --- ParallelTerminationStrategy: PID 28343 died... 10:22:54.162060 run iperf3-srv_10.42.42.10(pid=28343): Terminated {rc=256} 10:22:54.209311 --- ParallelTerminationStrategy: PID 28344 died... 10:22:54.228874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28344): Terminated: ok {rc=0} 10:22:54.276143 --- ParallelTerminationStrategy: PID 28345 died... 10:22:54.295832 run iperf3-srv_10.42.42.10(pid=28345): Terminated {rc=256} 10:22:54.342803 --- ParallelTerminationStrategy: PID 28348 died... 10:22:54.362630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28348): Terminated: ok {rc=0} 10:22:54.409736 --- ParallelTerminationStrategy: PID 28351 died... 10:22:54.429492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28351): Terminated: ok {rc=0} 10:22:54.476592 --- ParallelTerminationStrategy: PID 28354 died... 10:22:54.496472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28354): Terminated: ok {rc=0} 10:22:54.585558 bus /gobi_4: Setting Powered False 10:22:55.684932 bus /gobi_4: Setting Powered False 10:22:56.804485 bus /gobi_1: Setting Powered False 10:22:57.904063 bus /gobi_1: Setting Powered False 10:22:59.019860 bus /gobi_0: Setting Powered False 10:23:00.120163 bus /gobi_0: Setting Powered False 10:23:01.251006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:23:02.353559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.365168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:23:02.439493 tst ping.py: using LAC 27730 10:23:02.556798 tst ping.py: using RAC 190 10:23:02.672913 tst ping.py: using CellId 27730 10:23:02.789137 tst ping.py: using BVCI 27731 10:23:02.897675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.908573 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.919410 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.930202 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.940860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.951715 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.962617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:02.973415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:23:03.092915 tst ping.py:19: start network... 10:23:03.307623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:03.798812 run create_hlr_db(pid=28356): Launched 10:23:03.920645 bus /gobi_6: Setting Powered False 10:23:04.983928 run create_hlr_db(pid=28356): Terminated: ok {rc=0} 10:23:05.412006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28358): Launched 10:23:05.712294 run osmo-hlr_10.42.42.2(pid=28359): Launched 10:23:05.826044 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:06.361980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28361): Launched 10:23:06.659688 run osmo-stp_10.42.42.5(pid=28362): Launched 10:23:06.773086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:07.287645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28364): Launched 10:23:07.403525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:07.655105 run patchelf(pid=28365): Launched 10:23:07.820824 run osmo-stp_10.42.42.5(pid=28362): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28362)] 10:23:07.947084 run osmo-stp_10.42.42.5(pid=28362): stdout: | (launched: 2022-12-10_10:23:06.605746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:08.074963 run osmo-stp_10.42.42.5(pid=28362): stderr: | 20221210102306774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102306774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102306774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102306775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102306775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102306775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102306775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:08.203268 run osmo-stp_10.42.42.5(pid=28362): stdout: | (launched: 2022-12-10_10:23:06.605746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:08.324588 run osmo-stp_10.42.42.5(pid=28362): stderr: | 20221210102306774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102306774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102306774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102306775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102306775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102306775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102306775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:08.469255 run patchelf(pid=28365): Terminating (SIGINT) 10:23:08.636747 run patchelf(pid=28365): Terminated: ok {rc=0} 10:23:08.757646 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28362): Process ended prematurely: osmo-stp_10.42.42.5(pid=28362) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28362)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 10:23:08.766397 tst ping.py:22: Test FAILED (6.4 sec) 10:23:08.793141 run osmo-hlr_10.42.42.2(pid=28359): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28359)] 10:23:08.841124 run osmo-hlr_10.42.42.2(pid=28359): stdout: | (launched: 2022-12-10_10:23:05.657862) 10:23:08.890350 run osmo-hlr_10.42.42.2(pid=28359): stderr: | 20221210102305833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102305833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102305834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102305834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102305834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102305834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102305846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102305855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102305855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102305855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:08.939857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28358): Terminating (SIGTERM) 10:23:08.979854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28361): Terminating (SIGTERM) 10:23:09.019925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28364): Terminating (SIGTERM) 10:23:09.060128 --- ParallelTerminationStrategy: PID 28358 died... 10:23:09.079355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28358): Terminated: ok {rc=0} 10:23:09.123735 --- ParallelTerminationStrategy: PID 28361 died... 10:23:09.142459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28361): Terminated: ok {rc=0} 10:23:09.186430 --- ParallelTerminationStrategy: PID 28364 died... 10:23:09.205224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28364): Terminated: ok {rc=0} 10:23:09.291360 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:23:10.381377 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:10.394507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:23:10.468319 tst ping_idle_ping.py: using LAC 27731 10:23:10.594008 tst ping_idle_ping.py: using RAC 191 10:23:10.720243 tst ping_idle_ping.py: using CellId 27731 10:23:10.845083 tst ping_idle_ping.py: using BVCI 27732 10:23:10.963269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:10.974743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:10.986120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:10.998389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:11.010855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:11.023210 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:11.035668 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:23:11.047721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:23:11.162577 tst ping_idle_ping.py:24: start network... 10:23:11.363230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:11.828341 run create_hlr_db(pid=28366): Launched 10:23:11.951301 bus /gobi_6: Setting Powered False 10:23:13.012372 run create_hlr_db(pid=28366): Terminated: ok {rc=0} 10:23:13.450023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Launched 10:23:13.770732 run osmo-hlr_10.42.42.2(pid=28369): Launched 10:23:13.893142 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:14.448537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Launched 10:23:14.768518 run osmo-stp_10.42.42.5(pid=28372): Launched 10:23:14.891344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:15.445172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Launched 10:23:15.569507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:15.864072 run patchelf(pid=28375): Launched 10:23:16.052365 run osmo-stp_10.42.42.5(pid=28372): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] 10:23:16.185303 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-10_10:23:14.710944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:16.318938 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221210102314900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102314900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102314901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102314901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102314901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102314902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102314902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:16.458922 run osmo-stp_10.42.42.5(pid=28372): stdout: | (launched: 2022-12-10_10:23:14.710944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:16.612348 run osmo-stp_10.42.42.5(pid=28372): stderr: | 20221210102314900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102314900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102314901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102314901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102314901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102314902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102314902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:16.806231 run patchelf(pid=28375): Terminating (SIGINT) 10:23:16.994776 run patchelf(pid=28375): Terminated: ok {rc=0} 10:23:17.121339 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28372): Process ended prematurely: osmo-stp_10.42.42.5(pid=28372) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:23:17.131401 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:23:17.161365 run osmo-hlr_10.42.42.2(pid=28369): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28369)] 10:23:17.211379 run osmo-hlr_10.42.42.2(pid=28369): stdout: | (launched: 2022-12-10_10:23:13.713156) 10:23:17.262912 run osmo-hlr_10.42.42.2(pid=28369): stderr: | 20221210102313910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102313910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102313910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102313910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102313910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102313910 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102313922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102313930 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102313931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102313931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:17.327129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminating (SIGTERM) 10:23:17.374190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminating (SIGTERM) 10:23:17.418263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Terminating (SIGTERM) 10:23:17.461801 --- ParallelTerminationStrategy: PID 28368 died... 10:23:17.481339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28368): Terminated: ok {rc=0} 10:23:17.528766 --- ParallelTerminationStrategy: PID 28371 died... 10:23:17.547905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28371): Terminated: ok {rc=0} 10:23:17.594121 --- ParallelTerminationStrategy: PID 28374 died... 10:23:17.613349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28374): Terminated: ok {rc=0} 10:23:17.707186 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:23:19.049331 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:19.056337 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:23:19.091166 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:23:19.127676 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:23:19.186034 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:23:19.220195 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:23:19.255243 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:23:19.811624 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:23:19.818435 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:19.830862 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:23:19.901254 tst switch_tch_pdch.py: using LAC 27732 10:23:20.020063 tst switch_tch_pdch.py: using RAC 192 10:23:20.140023 tst switch_tch_pdch.py: using CellId 27732 10:23:20.259888 tst switch_tch_pdch.py: using BVCI 27733 10:23:20.372694 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:20.385113 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:20.397466 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:20.409693 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:20.422002 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:20.434328 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:20.446949 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:23:20.459294 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:23:20.581019 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:23:20.703942 tst switch_tch_pdch.py:51: start network... 10:23:20.909174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:21.390398 run create_hlr_db(pid=28651): Launched 10:23:21.546082 bus /gobi_6: Setting Powered False 10:23:22.606127 run create_hlr_db(pid=28651): Terminated: ok {rc=0} 10:23:23.054298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28653): Launched 10:23:23.385759 run osmo-hlr_10.42.42.2(pid=28654): Launched 10:23:23.619488 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:24.341274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28656): Launched 10:23:24.666116 run osmo-stp_10.42.42.5(pid=28657): Launched 10:23:24.904545 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:25.609179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28659): Launched 10:23:25.743941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:26.008799 run patchelf(pid=28660): Launched 10:23:26.196122 run osmo-stp_10.42.42.5(pid=28657): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28657)] 10:23:26.325888 run osmo-stp_10.42.42.5(pid=28657): stdout: | (launched: 2022-12-10_10:23:24.604202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:26.457814 run osmo-stp_10.42.42.5(pid=28657): stderr: | 20221210102324939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102324940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102324940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102324940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102324949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102324949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102324949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:26.590622 run osmo-stp_10.42.42.5(pid=28657): stdout: | (launched: 2022-12-10_10:23:24.604202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:26.716438 run osmo-stp_10.42.42.5(pid=28657): stderr: | 20221210102324939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102324940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102324940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102324940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102324949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102324949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102324949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:26.864995 run patchelf(pid=28660): Terminating (SIGINT) 10:23:27.038195 run patchelf(pid=28660): Terminated: ok {rc=0} 10:23:27.163080 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28657): Process ended prematurely: osmo-stp_10.42.42.5(pid=28657) [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28657)] [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:23:27.174066 tst switch_tch_pdch.py:54: Test FAILED (7.3 sec) 10:23:27.202318 run osmo-hlr_10.42.42.2(pid=28654): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28654)] 10:23:27.252187 run osmo-hlr_10.42.42.2(pid=28654): stdout: | (launched: 2022-12-10_10:23:23.316019) 10:23:27.303034 run osmo-hlr_10.42.42.2(pid=28654): stderr: | 20221210102323663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102323663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102323663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102323663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102323663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102323663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102323680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102323692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102323697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102323697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:27.355675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28653): Terminating (SIGTERM) 10:23:27.397368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28656): Terminating (SIGTERM) 10:23:27.440640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28659): Terminating (SIGTERM) 10:23:27.484747 --- ParallelTerminationStrategy: PID 28653 died... 10:23:27.504639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28653): Terminated: ok {rc=0} 10:23:27.552859 --- ParallelTerminationStrategy: PID 28656 died... 10:23:27.572936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28656): Terminated: ok {rc=0} 10:23:27.618784 --- ParallelTerminationStrategy: PID 28659 died... 10:23:27.638478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28659): Terminated: ok {rc=0} 10:23:27.727967 bus /gobi_0: Setting Powered False 10:23:28.827225 bus /gobi_0: Setting Powered False 10:23:29.942841 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:23:31.259417 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:31.265590 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:23:31.300803 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:23:31.337285 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:23:31.411458 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:23:31.480478 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:23:31.539243 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:23:32.121123 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:23:32.131115 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.162193 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:23:32.247575 tst switch_tch_pdch.py: using LAC 27733 10:23:32.385773 tst switch_tch_pdch.py: using RAC 193 10:23:32.547522 tst switch_tch_pdch.py: using CellId 27733 10:23:32.692335 tst switch_tch_pdch.py: using BVCI 27734 10:23:32.852641 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.866493 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.880377 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.893087 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.906305 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.919607 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.931786 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:23:32.943392 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:23:33.061872 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:23:33.182077 tst switch_tch_pdch.py:51: start network... 10:23:33.398178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:33.877986 run create_hlr_db(pid=28664): Launched 10:23:34.035486 bus /gobi_6: Setting Powered False 10:23:35.097130 run create_hlr_db(pid=28664): Terminated: ok {rc=0} 10:23:35.514079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28666): Launched 10:23:35.845183 run osmo-hlr_10.42.42.2(pid=28667): Launched 10:23:36.089268 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:36.793441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28669): Launched 10:23:37.121761 run osmo-stp_10.42.42.5(pid=28670): Launched 10:23:37.366313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:23:37.982255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28672): Launched 10:23:38.119348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:23:38.399041 run patchelf(pid=28673): Launched 10:23:38.591884 run osmo-stp_10.42.42.5(pid=28670): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28670)] 10:23:38.731012 run osmo-stp_10.42.42.5(pid=28670): stdout: | (launched: 2022-12-10_10:23:37.057772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:38.872092 run osmo-stp_10.42.42.5(pid=28670): stderr: | 20221210102337347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102337347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102337347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102337348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102337348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102337348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102337348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:39.013673 run osmo-stp_10.42.42.5(pid=28670): stdout: | (launched: 2022-12-10_10:23:37.057772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:39.149177 run osmo-stp_10.42.42.5(pid=28670): stderr: | 20221210102337347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102337347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102337347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102337348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102337348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102337348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102337348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:39.308474 run patchelf(pid=28673): Terminating (SIGINT) 10:23:39.492526 run patchelf(pid=28673): Terminated: ok {rc=0} 10:23:39.626013 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28670): Process ended prematurely: osmo-stp_10.42.42.5(pid=28670) [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28670)] [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:23:39.636680 tst switch_tch_pdch.py:54: Test FAILED (7.5 sec) 10:23:39.669110 run osmo-hlr_10.42.42.2(pid=28667): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28667)] 10:23:39.722449 run osmo-hlr_10.42.42.2(pid=28667): stdout: | (launched: 2022-12-10_10:23:35.783915) 10:23:39.777331 run osmo-hlr_10.42.42.2(pid=28667): stderr: | 20221210102336129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102336129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102336129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102336129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102336129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102336129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102336152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102336165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102336165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102336165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:39.832604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28666): Terminating (SIGTERM) 10:23:39.877604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28669): Terminating (SIGTERM) 10:23:39.924015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28672): Terminating (SIGTERM) 10:23:39.971049 --- ParallelTerminationStrategy: PID 28666 died... 10:23:39.992125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28666): Terminated: ok {rc=0} 10:23:40.043544 --- ParallelTerminationStrategy: PID 28669 died... 10:23:40.064321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28669): Terminated: ok {rc=0} 10:23:40.114766 --- ParallelTerminationStrategy: PID 28672 died... 10:23:40.135587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28672): Terminated: ok {rc=0} 10:23:40.228251 bus /gobi_0: Setting Powered False 10:23:41.331548 bus /gobi_0: Setting Powered False 10:23:42.450482 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_sms:trx-umtrx --------------------------------------------------------------------- 10:23:43.705590 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:43.709177 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:23:43.741236 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:23:43.747911 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:23:43.798671 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:23:43.830855 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:23:43.837426 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:23:44.376016 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:23:44.380722 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:23:44.391509 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:23:44.438103 tst mo_mt_sms.py: using LAC 27734 10:23:44.557067 tst mo_mt_sms.py: using RAC 194 10:23:44.674483 tst mo_mt_sms.py: using CellId 27734 10:23:44.801459 tst mo_mt_sms.py: using BVCI 27735 10:23:44.917962 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:23:45.030994 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:23:45.146730 tst mo_mt_sms.py:9: start nitb and bts... 10:23:45.365762 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:23:46.030791 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28679): Launched 10:23:46.366358 run osmo-nitb_10.42.42.2(pid=28680): Launched 10:23:46.561512 run osmo-nitb_10.42.42.2(pid=28680): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28680)] 10:23:46.709082 run osmo-nitb_10.42.42.2(pid=28680): stdout: | (launched: 2022-12-10_10:23:46.303238) 10:23:46.858765 run osmo-nitb_10.42.42.2(pid=28680): stderr: | (launched: 2022-12-10_10:23:46.351544) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:23:47.008698 run osmo-nitb_10.42.42.2(pid=28680): stdout: | (launched: 2022-12-10_10:23:46.303238) 10:23:47.152599 run osmo-nitb_10.42.42.2(pid=28680): stderr: | (launched: 2022-12-10_10:23:46.351544) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28680): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28680) [trial-2373↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28680)] 10:23:47.503580 tst osmo-nitb_10.42.42.2(pid=28680): stdout: | (launched: 2022-12-10_10:23:46.303238) 10:23:47.633363 tst osmo-nitb_10.42.42.2(pid=28680): stderr: | (launched: 2022-12-10_10:23:46.351544) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:23:47.786232 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28680): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28680) [trial-2373↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28680)] [trial-2373↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 10:23:47.795284 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 10:23:47.802459 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28679): Terminating (SIGTERM) 10:23:48.014447 --- ParallelTerminationStrategy: PID 28679 died... 10:23:48.036179 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28679): Terminated: ok {rc=0} 10:23:48.126150 bus /sierra_3: Setting Powered False 10:23:49.227511 bus /sierra_3: Setting Powered False 10:23:50.347506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:trx-umtrx --------------------------------------------------------------------- 10:23:51.546759 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:23:51.551002 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:23:51.585581 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:23:51.613420 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 10:23:51.667072 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:23:51.700784 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:23:51.728208 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 10:23:52.275784 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 10:23:52.280783 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:23:52.291876 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 10:23:52.340234 tst mo_mt_sms.py: using LAC 27735 10:23:52.466109 tst mo_mt_sms.py: using RAC 195 10:23:52.590771 tst mo_mt_sms.py: using CellId 27735 10:23:52.720656 tst mo_mt_sms.py: using BVCI 27736 10:23:52.837583 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:23:52.848585 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:23:52.859437 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:23:52.870560 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:23:52.881664 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:23:52.892597 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:23:53.010268 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 10:23:53.123931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:23:53.586282 run create_hlr_db(pid=28686): Launched 10:23:53.709972 bus /sierra_2: Setting Powered False 10:23:54.769940 run create_hlr_db(pid=28686): Terminated: ok {rc=0} 10:23:55.206729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28688): Launched 10:23:55.525974 run osmo-hlr_10.42.42.2(pid=28689): Launched 10:23:55.648329 run osmo-stp_10.42.42.5: Starting osmo-stp 10:23:56.197173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28691): Launched 10:23:56.497560 run osmo-stp_10.42.42.5(pid=28692): Launched 10:23:56.611796 run osmo-msc_10.42.42.6: Starting osmo-msc 10:23:57.154610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28694): Launched 10:23:57.452738 run osmo-msc_10.42.42.6(pid=28695): Launched 10:23:57.620743 run osmo-stp_10.42.42.5(pid=28692): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28692)] 10:23:57.747490 run osmo-stp_10.42.42.5(pid=28692): stdout: | (launched: 2022-12-10_10:23:56.442672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:57.873678 run osmo-stp_10.42.42.5(pid=28692): stderr: | 20221210102356615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102356615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102356615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102356615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102356616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102356616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102356616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:57.998638 run osmo-stp_10.42.42.5(pid=28692): stdout: | (launched: 2022-12-10_10:23:56.442672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:23:58.117722 run osmo-stp_10.42.42.5(pid=28692): stderr: | 20221210102356615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102356615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102356615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102356615 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102356616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102356616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102356616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:23:58.259872 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28692): Process ended prematurely: osmo-stp_10.42.42.5(pid=28692) [trial-2373↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28692)] [trial-2373↪sms:trx-umtrx↪mo_mt_sms.py:16] 10:23:58.268447 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 10:23:58.294353 run osmo-hlr_10.42.42.2(pid=28689): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28689)] 10:23:58.342017 run osmo-hlr_10.42.42.2(pid=28689): stdout: | (launched: 2022-12-10_10:23:55.468731) 10:23:58.391624 run osmo-hlr_10.42.42.2(pid=28689): stderr: | 20221210102355665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102355665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102355665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102355665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102355665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102355665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102355677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102355686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102355686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102355686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:23:58.460684 run osmo-msc_10.42.42.6(pid=28695): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28695)] 10:23:58.508363 run osmo-msc_10.42.42.6(pid=28695): stdout: | (launched: 2022-12-10_10:23:57.398511) 10:23:58.557683 run osmo-msc_10.42.42.6(pid=28695): stderr: | 20221210102357672 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102357672 DLGLOBAL DEBUG validating counter group 0x7f935af48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102357672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102357672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102357672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102357673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102357674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102357675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102357675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102357675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:23:58.607201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28688): Terminating (SIGTERM) 10:23:58.646868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28691): Terminating (SIGTERM) 10:23:58.686606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28694): Terminating (SIGTERM) 10:23:58.726524 --- ParallelTerminationStrategy: PID 28688 died... 10:23:58.745420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28688): Terminated: ok {rc=0} 10:23:58.789257 --- ParallelTerminationStrategy: PID 28691 died... 10:23:58.807585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28691): Terminated: ok {rc=0} 10:23:58.851309 --- ParallelTerminationStrategy: PID 28694 died... 10:23:58.869827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28694): Terminated: ok {rc=0} 10:23:58.953607 bus /sierra_3: Setting Powered False 10:24:00.050774 bus /sierra_3: Setting Powered False 10:24:01.183752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 10:24:02.421496 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:02.425959 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:24:02.460605 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 10:24:02.467637 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:24:02.503973 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:24:02.536939 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 10:24:02.543769 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:24:03.064102 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:24:03.070193 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 10:24:03.081854 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:24:03.131439 tst assert_extension.py: using LAC 27736 10:24:03.250322 tst assert_extension.py: using RAC 196 10:24:03.368666 tst assert_extension.py: using CellId 27736 10:24:03.488124 tst assert_extension.py: using BVCI 27737 10:24:03.597826 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:24:03.714369 tst assert_extension.py:10: start nitb and bts... 10:24:03.930442 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:24:04.583280 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28700): Launched 10:24:04.902684 run osmo-nitb_10.42.42.2(pid=28701): Launched 10:24:05.080124 run osmo-nitb_10.42.42.2(pid=28701): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28701)] 10:24:05.224621 run osmo-nitb_10.42.42.2(pid=28701): stdout: | (launched: 2022-12-10_10:24:04.845356) 10:24:05.369952 run osmo-nitb_10.42.42.2(pid=28701): stderr: | (launched: 2022-12-10_10:24:04.892643) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:24:05.515202 run osmo-nitb_10.42.42.2(pid=28701): stdout: | (launched: 2022-12-10_10:24:04.845356) 10:24:05.654349 run osmo-nitb_10.42.42.2(pid=28701): stderr: | (launched: 2022-12-10_10:24:04.892643) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28701): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28701) [trial-2373↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28701)] 10:24:06.023986 tst osmo-nitb_10.42.42.2(pid=28701): stdout: | (launched: 2022-12-10_10:24:04.845356) 10:24:06.154195 tst osmo-nitb_10.42.42.2(pid=28701): stderr: | (launched: 2022-12-10_10:24:04.892643) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:24:06.307407 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28701): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28701) [trial-2373↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28701)] [trial-2373↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 10:24:06.316654 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:24:06.323721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28700): Terminating (SIGTERM) 10:24:06.535591 --- ParallelTerminationStrategy: PID 28700 died... 10:24:06.557382 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28700): Terminated: ok {rc=0} 10:24:06.645495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:trx-umtrx --------------------------------------------------------------------- 10:24:07.825056 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:07.829487 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:24:07.863865 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:24:07.891782 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 10:24:07.927799 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:24:07.961562 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:24:07.989562 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 10:24:08.518132 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 10:24:08.523628 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:24:08.534880 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 10:24:08.586616 tst assert_extension.py: using LAC 27737 10:24:08.705085 tst assert_extension.py: using RAC 197 10:24:08.823153 tst assert_extension.py: using CellId 27737 10:24:08.941646 tst assert_extension.py: using BVCI 27738 10:24:09.049524 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:24:09.060244 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:24:09.070922 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:24:09.081535 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:24:09.091885 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:24:09.102335 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 10:24:09.218670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:09.711918 run create_hlr_db(pid=28705): Launched 10:24:09.834246 bus /sierra_2: Setting Powered False 10:24:10.897881 run create_hlr_db(pid=28705): Terminated: ok {rc=0} 10:24:11.325720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28707): Launched 10:24:11.624906 run osmo-hlr_10.42.42.2(pid=28708): Launched 10:24:11.739671 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:12.261699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28710): Launched 10:24:12.560873 run osmo-stp_10.42.42.5(pid=28711): Launched 10:24:12.675262 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:13.212790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28713): Launched 10:24:13.509470 run osmo-msc_10.42.42.6(pid=28714): Launched 10:24:13.679026 run osmo-stp_10.42.42.5(pid=28711): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28711)] 10:24:13.805974 run osmo-stp_10.42.42.5(pid=28711): stdout: | (launched: 2022-12-10_10:24:12.506274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:13.932537 run osmo-stp_10.42.42.5(pid=28711): stderr: | 20221210102412679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102412679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102412679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102412680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102412680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102412680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102412680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:14.057887 run osmo-stp_10.42.42.5(pid=28711): stdout: | (launched: 2022-12-10_10:24:12.506274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:14.177186 run osmo-stp_10.42.42.5(pid=28711): stderr: | 20221210102412679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102412679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102412679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102412680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102412680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102412680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102412680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:14.319253 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28711): Process ended prematurely: osmo-stp_10.42.42.5(pid=28711) [trial-2373↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28711)] [trial-2373↪ussd:trx-umtrx↪assert_extension.py:17] 10:24:14.327585 tst assert_extension.py:17: Test FAILED (5.8 sec) 10:24:14.353752 run osmo-hlr_10.42.42.2(pid=28708): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28708)] 10:24:14.401485 run osmo-hlr_10.42.42.2(pid=28708): stdout: | (launched: 2022-12-10_10:24:11.570424) 10:24:14.450990 run osmo-hlr_10.42.42.2(pid=28708): stderr: | 20221210102411746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102411746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102411746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102411746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102411746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102411746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102411757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102411766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102411766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102411766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:14.519831 run osmo-msc_10.42.42.6(pid=28714): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28714)] 10:24:14.567711 run osmo-msc_10.42.42.6(pid=28714): stdout: | (launched: 2022-12-10_10:24:13.455372) 10:24:14.617042 run osmo-msc_10.42.42.6(pid=28714): stderr: | 20221210102413725 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102413726 DLGLOBAL DEBUG validating counter group 0x7fcdc6c35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102413726 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102413726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102413726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102413726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102413728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102413730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102413730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102413730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:14.666512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28707): Terminating (SIGTERM) 10:24:14.706272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28710): Terminating (SIGTERM) 10:24:14.745909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28713): Terminating (SIGTERM) 10:24:14.785847 --- ParallelTerminationStrategy: PID 28707 died... 10:24:14.804784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28707): Terminated: ok {rc=0} 10:24:14.849471 --- ParallelTerminationStrategy: PID 28710 died... 10:24:14.868016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28710): Terminated: ok {rc=0} 10:24:14.911708 --- ParallelTerminationStrategy: PID 28713 died... 10:24:14.930219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28713): Terminated: ok {rc=0} 10:24:15.013345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:24:16.222525 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:16.231224 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:24:16.279493 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:24:16.312363 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:24:16.363268 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:24:16.410376 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:24:16.445488 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:24:17.005764 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:24:17.063909 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:17.076796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:24:17.154646 tst mo_mt_call.py: using LAC 27738 10:24:17.284739 tst mo_mt_call.py: using RAC 198 10:24:17.402471 tst mo_mt_call.py: using CellId 27738 10:24:17.520093 tst mo_mt_call.py: using BVCI 27739 10:24:17.630900 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:17.642176 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:17.653139 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:17.663958 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:17.674910 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:17.685722 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:24:17.806191 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:24:17.923836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:18.396083 run create_hlr_db(pid=28719): Launched 10:24:18.520837 bus /sierra_2: Setting Powered False 10:24:19.581963 run create_hlr_db(pid=28719): Terminated: ok {rc=0} 10:24:20.024232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28721): Launched 10:24:20.350166 run osmo-hlr_10.42.42.2(pid=28722): Launched 10:24:20.474360 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:21.030925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28724): Launched 10:24:21.355677 run osmo-stp_10.42.42.5(pid=28725): Launched 10:24:21.480392 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:22.068434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28727): Launched 10:24:22.393279 run osmo-msc_10.42.42.6(pid=28728): Launched 10:24:22.575199 run osmo-stp_10.42.42.5(pid=28725): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28725)] 10:24:22.711856 run osmo-stp_10.42.42.5(pid=28725): stdout: | (launched: 2022-12-10_10:24:21.297478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:22.849264 run osmo-stp_10.42.42.5(pid=28725): stderr: | 20221210102421490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102421490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102421490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102421490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102421491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102421491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102421491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:22.985420 run osmo-stp_10.42.42.5(pid=28725): stdout: | (launched: 2022-12-10_10:24:21.297478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:23.114423 run osmo-stp_10.42.42.5(pid=28725): stderr: | 20221210102421490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102421490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102421490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102421490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102421491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102421491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102421491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:23.269497 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28725): Process ended prematurely: osmo-stp_10.42.42.5(pid=28725) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28725)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:24:23.279031 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:24:23.307398 run osmo-hlr_10.42.42.2(pid=28722): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28722)] 10:24:23.357862 run osmo-hlr_10.42.42.2(pid=28722): stdout: | (launched: 2022-12-10_10:24:20.291765) 10:24:23.410006 run osmo-hlr_10.42.42.2(pid=28722): stderr: | 20221210102420491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102420491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102420491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102420491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102420492 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102420492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102420504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102420512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102420512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102420512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:23.482631 run osmo-msc_10.42.42.6(pid=28728): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28728)] 10:24:23.533168 run osmo-msc_10.42.42.6(pid=28728): stdout: | (launched: 2022-12-10_10:24:22.334974) 10:24:23.585259 run osmo-msc_10.42.42.6(pid=28728): stderr: | 20221210102422655 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102422656 DLGLOBAL DEBUG validating counter group 0x7f809dc56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102422656 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102422656 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102422656 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102422656 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102422658 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102422658 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102422658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102422658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:23.637567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28721): Terminating (SIGTERM) 10:24:23.679644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28724): Terminating (SIGTERM) 10:24:23.722021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28727): Terminating (SIGTERM) 10:24:23.764302 --- ParallelTerminationStrategy: PID 28721 died... 10:24:23.784170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28721): Terminated: ok {rc=0} 10:24:23.830995 --- ParallelTerminationStrategy: PID 28724 died... 10:24:23.850509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28724): Terminated: ok {rc=0} 10:24:23.897125 --- ParallelTerminationStrategy: PID 28727 died... 10:24:23.916601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28727): Terminated: ok {rc=0} 10:24:24.005802 bus /sierra_3: Setting Powered False 10:24:25.105736 bus /sierra_3: Setting Powered False 10:24:26.222388 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:24:27.372236 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:27.384393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:24:27.456408 tst mo_mt_call_osmux.py: using LAC 27739 10:24:27.583844 tst mo_mt_call_osmux.py: using RAC 199 10:24:27.713429 tst mo_mt_call_osmux.py: using CellId 27739 10:24:27.833859 tst mo_mt_call_osmux.py: using BVCI 27740 10:24:27.944262 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:27.955507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:27.966539 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:27.977622 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:27.988540 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:24:27.999483 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:24:28.118595 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:24:28.237158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:28.710304 run create_hlr_db(pid=28730): Launched 10:24:28.834535 bus /sierra_2: Setting Powered False 10:24:29.894830 run create_hlr_db(pid=28730): Terminated: ok {rc=0} 10:24:30.318438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28732): Launched 10:24:30.620714 run osmo-hlr_10.42.42.2(pid=28733): Launched 10:24:30.736084 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:31.330480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28735): Launched 10:24:31.673620 run osmo-stp_10.42.42.5(pid=28736): Launched 10:24:31.924555 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:32.591166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28738): Launched 10:24:32.894809 run osmo-msc_10.42.42.6(pid=28739): Launched 10:24:33.064156 run osmo-stp_10.42.42.5(pid=28736): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28736)] 10:24:33.191627 run osmo-stp_10.42.42.5(pid=28736): stdout: | (launched: 2022-12-10_10:24:31.609121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:33.319317 run osmo-stp_10.42.42.5(pid=28736): stderr: | 20221210102431911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102431911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102431911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102431912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102431912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102431912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102431912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:33.446128 run osmo-stp_10.42.42.5(pid=28736): stdout: | (launched: 2022-12-10_10:24:31.609121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:33.566557 run osmo-stp_10.42.42.5(pid=28736): stderr: | 20221210102431911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102431911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102431911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102431912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102431912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102431912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102431912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:33.711148 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28736): Process ended prematurely: osmo-stp_10.42.42.5(pid=28736) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28736)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:24:33.720115 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:24:33.746688 run osmo-hlr_10.42.42.2(pid=28733): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28733)] 10:24:33.794580 run osmo-hlr_10.42.42.2(pid=28733): stdout: | (launched: 2022-12-10_10:24:30.566230) 10:24:33.844225 run osmo-hlr_10.42.42.2(pid=28733): stderr: | 20221210102430744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102430744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102430744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102430744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102430744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102430744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102430756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102430765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102430765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102430766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:33.913269 run osmo-msc_10.42.42.6(pid=28739): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28739)] 10:24:33.960785 run osmo-msc_10.42.42.6(pid=28739): stdout: | (launched: 2022-12-10_10:24:32.839726) 10:24:34.009947 run osmo-msc_10.42.42.6(pid=28739): stderr: | 20221210102433111 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102433112 DLGLOBAL DEBUG validating counter group 0x7f9209de5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102433112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102433112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102433112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102433112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102433114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102433115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102433116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102433116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:34.059491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28732): Terminating (SIGTERM) 10:24:34.099247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28735): Terminating (SIGTERM) 10:24:34.138948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28738): Terminating (SIGTERM) 10:24:34.179169 --- ParallelTerminationStrategy: PID 28732 died... 10:24:34.198701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28732): Terminated: ok {rc=0} 10:24:34.243193 --- ParallelTerminationStrategy: PID 28735 died... 10:24:34.261971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28735): Terminated: ok {rc=0} 10:24:34.305888 --- ParallelTerminationStrategy: PID 28738 died... 10:24:34.324399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28738): Terminated: ok {rc=0} 10:24:34.409776 bus /sierra_3: Setting Powered False 10:24:35.509096 bus /sierra_3: Setting Powered False 10:24:36.624484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:24:37.878223 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:37.884624 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:24:37.917176 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:24:37.943680 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:24:37.994351 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:24:38.026509 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:24:38.052852 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:24:38.606452 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:24:38.655276 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:38.666443 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:24:38.746017 tst mo_mt_call.py: using LAC 27740 10:24:38.877408 tst mo_mt_call.py: using RAC 200 10:24:39.019529 tst mo_mt_call.py: using CellId 27740 10:24:39.146469 tst mo_mt_call.py: using BVCI 27741 10:24:39.266698 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:39.278496 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:39.289883 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:39.301512 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:39.313362 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:39.324881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:39.444005 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:39.563761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:40.066772 run create_hlr_db(pid=28744): Launched 10:24:40.191608 bus /sierra_2: Setting Powered False 10:24:41.255586 run create_hlr_db(pid=28744): Terminated: ok {rc=0} 10:24:41.690792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28746): Launched 10:24:41.995362 run osmo-hlr_10.42.42.2(pid=28747): Launched 10:24:42.112650 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:42.638396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28749): Launched 10:24:42.941693 run osmo-stp_10.42.42.5(pid=28750): Launched 10:24:43.057628 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:43.607079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28752): Launched 10:24:43.910638 run osmo-msc_10.42.42.6(pid=28753): Launched 10:24:44.080627 run osmo-stp_10.42.42.5(pid=28750): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28750)] 10:24:44.208897 run osmo-stp_10.42.42.5(pid=28750): stdout: | (launched: 2022-12-10_10:24:42.886883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:44.338377 run osmo-stp_10.42.42.5(pid=28750): stderr: | 20221210102443056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102443056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102443056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102443056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102443057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102443057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102443057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:44.465270 run osmo-stp_10.42.42.5(pid=28750): stdout: | (launched: 2022-12-10_10:24:42.886883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:44.586038 run osmo-stp_10.42.42.5(pid=28750): stderr: | 20221210102443056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102443056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102443056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102443056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102443057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102443057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102443057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:44.730734 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28750): Process ended prematurely: osmo-stp_10.42.42.5(pid=28750) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28750)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:24:44.739601 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:24:44.766234 run osmo-hlr_10.42.42.2(pid=28747): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28747)] 10:24:44.814436 run osmo-hlr_10.42.42.2(pid=28747): stdout: | (launched: 2022-12-10_10:24:41.940229) 10:24:44.864163 run osmo-hlr_10.42.42.2(pid=28747): stderr: | 20221210102442118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102442118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102442118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102442118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102442118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102442118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102442177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102442187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102442187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102442187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:44.933235 run osmo-msc_10.42.42.6(pid=28753): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28753)] 10:24:44.981138 run osmo-msc_10.42.42.6(pid=28753): stdout: | (launched: 2022-12-10_10:24:43.855736) 10:24:45.030625 run osmo-msc_10.42.42.6(pid=28753): stderr: | 20221210102444129 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102444130 DLGLOBAL DEBUG validating counter group 0x7f47dea9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102444130 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102444130 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102444130 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102444130 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102444133 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102444133 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102444133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102444134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:45.080522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28746): Terminating (SIGTERM) 10:24:45.120424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28749): Terminating (SIGTERM) 10:24:45.161038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28752): Terminating (SIGTERM) 10:24:45.201407 --- ParallelTerminationStrategy: PID 28746 died... 10:24:45.220743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28746): Terminated: ok {rc=0} 10:24:45.265132 --- ParallelTerminationStrategy: PID 28749 died... 10:24:45.283936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28749): Terminated: ok {rc=0} 10:24:45.328437 --- ParallelTerminationStrategy: PID 28752 died... 10:24:45.347381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28752): Terminated: ok {rc=0} 10:24:45.430918 bus /sierra_3: Setting Powered False 10:24:46.532299 bus /sierra_3: Setting Powered False 10:24:47.658917 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:24:48.809999 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:48.822253 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:24:48.894686 tst mo_mt_call_osmux.py: using LAC 27741 10:24:49.023018 tst mo_mt_call_osmux.py: using RAC 201 10:24:49.150215 tst mo_mt_call_osmux.py: using CellId 27741 10:24:49.277390 tst mo_mt_call_osmux.py: using BVCI 27742 10:24:49.395180 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:49.406898 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:49.418409 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:49.430141 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:49.441881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:24:49.453598 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:49.572829 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:24:49.692793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:24:50.164096 run create_hlr_db(pid=28755): Launched 10:24:50.289055 bus /sierra_2: Setting Powered False 10:24:51.350041 run create_hlr_db(pid=28755): Terminated: ok {rc=0} 10:24:51.792657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28757): Launched 10:24:52.117663 run osmo-hlr_10.42.42.2(pid=28758): Launched 10:24:52.243410 run osmo-stp_10.42.42.5: Starting osmo-stp 10:24:52.807841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28760): Launched 10:24:53.133146 run osmo-stp_10.42.42.5(pid=28761): Launched 10:24:53.257526 run osmo-msc_10.42.42.6: Starting osmo-msc 10:24:53.843446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28763): Launched 10:24:54.169374 run osmo-msc_10.42.42.6(pid=28764): Launched 10:24:54.352634 run osmo-stp_10.42.42.5(pid=28761): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28761)] 10:24:54.490528 run osmo-stp_10.42.42.5(pid=28761): stdout: | (launched: 2022-12-10_10:24:53.073967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:54.628932 run osmo-stp_10.42.42.5(pid=28761): stderr: | 20221210102453266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102453266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102453266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102453267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102453267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102453267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102453267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:54.766450 run osmo-stp_10.42.42.5(pid=28761): stdout: | (launched: 2022-12-10_10:24:53.073967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:24:54.896428 run osmo-stp_10.42.42.5(pid=28761): stderr: | 20221210102453266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102453266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102453266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102453267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102453267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102453267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102453267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:24:55.052094 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28761): Process ended prematurely: osmo-stp_10.42.42.5(pid=28761) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28761)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:24:55.061671 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:24:55.089931 run osmo-hlr_10.42.42.2(pid=28758): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28758)] 10:24:55.140646 run osmo-hlr_10.42.42.2(pid=28758): stdout: | (launched: 2022-12-10_10:24:52.059515) 10:24:55.192578 run osmo-hlr_10.42.42.2(pid=28758): stderr: | 20221210102452259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102452259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102452259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102452259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102452259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102452260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102452271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102452280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102452280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102452280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:24:55.265294 run osmo-msc_10.42.42.6(pid=28764): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28764)] 10:24:55.315601 run osmo-msc_10.42.42.6(pid=28764): stdout: | (launched: 2022-12-10_10:24:54.110373) 10:24:55.367607 run osmo-msc_10.42.42.6(pid=28764): stderr: | 20221210102454434 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102454434 DLGLOBAL DEBUG validating counter group 0x7efdf4e80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102454434 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102454434 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102454434 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102454434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102454436 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102454436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102454437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102454437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:24:55.419475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28757): Terminating (SIGTERM) 10:24:55.461203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28760): Terminating (SIGTERM) 10:24:55.502981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28763): Terminating (SIGTERM) 10:24:55.545229 --- ParallelTerminationStrategy: PID 28757 died... 10:24:55.565039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28757): Terminated: ok {rc=0} 10:24:55.611628 --- ParallelTerminationStrategy: PID 28760 died... 10:24:55.631095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28760): Terminated: ok {rc=0} 10:24:55.677491 --- ParallelTerminationStrategy: PID 28763 died... 10:24:55.696919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28763): Terminated: ok {rc=0} 10:24:55.785612 bus /sierra_3: Setting Powered False 10:24:56.884324 bus /sierra_3: Setting Powered False 10:24:58.000210 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:24:59.254334 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:24:59.261798 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:24:59.297331 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:24:59.325356 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:24:59.380243 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:24:59.414211 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:24:59.441994 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:24:59.991103 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:25:00.044459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:00.055993 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:25:00.127718 tst mo_mt_call.py: using LAC 27742 10:25:00.260290 tst mo_mt_call.py: using RAC 202 10:25:00.386547 tst mo_mt_call.py: using CellId 27742 10:25:00.513839 tst mo_mt_call.py: using BVCI 27743 10:25:00.632042 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:00.643557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:00.654936 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:00.666653 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:00.678342 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:00.689964 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:25:00.807942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:25:00.951774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:01.454773 run create_hlr_db(pid=28772): Launched 10:25:01.606648 bus /sierra_2: Setting Powered False 10:25:02.670648 run create_hlr_db(pid=28772): Terminated: ok {rc=0} 10:25:03.121328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28774): Launched 10:25:03.445977 run osmo-hlr_10.42.42.2(pid=28775): Launched 10:25:03.570242 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:04.130523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28777): Launched 10:25:04.457315 run osmo-stp_10.42.42.5(pid=28778): Launched 10:25:04.581758 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:05.167968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28780): Launched 10:25:05.493799 run osmo-msc_10.42.42.6(pid=28781): Launched 10:25:05.675803 run osmo-stp_10.42.42.5(pid=28778): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28778)] 10:25:05.813171 run osmo-stp_10.42.42.5(pid=28778): stdout: | (launched: 2022-12-10_10:25:04.398212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:05.951582 run osmo-stp_10.42.42.5(pid=28778): stderr: | 20221210102504591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102504592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102504592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102504592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102504593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102504593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102504593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:06.089432 run osmo-stp_10.42.42.5(pid=28778): stdout: | (launched: 2022-12-10_10:25:04.398212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:06.220178 run osmo-stp_10.42.42.5(pid=28778): stderr: | 20221210102504591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102504592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102504592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102504592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102504593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102504593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102504593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:06.375739 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28778): Process ended prematurely: osmo-stp_10.42.42.5(pid=28778) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28778)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:25:06.385482 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:25:06.414187 run osmo-hlr_10.42.42.2(pid=28775): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28775)] 10:25:06.465345 run osmo-hlr_10.42.42.2(pid=28775): stdout: | (launched: 2022-12-10_10:25:03.387721) 10:25:06.517949 run osmo-hlr_10.42.42.2(pid=28775): stderr: | 20221210102503584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102503585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102503585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102503585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102503585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102503585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102503598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102503608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102503608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102503608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:06.591272 run osmo-msc_10.42.42.6(pid=28781): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28781)] 10:25:06.642021 run osmo-msc_10.42.42.6(pid=28781): stdout: | (launched: 2022-12-10_10:25:05.435210) 10:25:06.694643 run osmo-msc_10.42.42.6(pid=28781): stderr: | 20221210102505756 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102505757 DLGLOBAL DEBUG validating counter group 0x7f81cfd69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102505757 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102505757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102505757 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102505757 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102505759 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102505759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102505760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102505760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:06.747287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28774): Terminating (SIGTERM) 10:25:06.789700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28777): Terminating (SIGTERM) 10:25:06.832108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28780): Terminating (SIGTERM) 10:25:06.874874 --- ParallelTerminationStrategy: PID 28774 died... 10:25:06.895045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28774): Terminated: ok {rc=0} 10:25:06.942607 --- ParallelTerminationStrategy: PID 28777 died... 10:25:06.962399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28777): Terminated: ok {rc=0} 10:25:07.009382 --- ParallelTerminationStrategy: PID 28780 died... 10:25:07.029171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28780): Terminated: ok {rc=0} 10:25:07.117265 bus /sierra_3: Setting Powered False 10:25:08.216735 bus /sierra_3: Setting Powered False 10:25:09.332573 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:25:10.480114 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:10.491850 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:25:10.561095 tst mo_mt_call_osmux.py: using LAC 27743 10:25:10.682580 tst mo_mt_call_osmux.py: using RAC 203 10:25:10.811927 tst mo_mt_call_osmux.py: using CellId 27743 10:25:10.939833 tst mo_mt_call_osmux.py: using BVCI 27744 10:25:11.059933 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:11.071703 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:11.083342 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:11.095303 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:11.107274 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:25:11.119014 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:25:11.235846 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:25:11.354949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:11.860287 run create_hlr_db(pid=28783): Launched 10:25:11.984931 bus /sierra_2: Setting Powered False 10:25:13.049891 run create_hlr_db(pid=28783): Terminated: ok {rc=0} 10:25:13.487690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28785): Launched 10:25:13.792478 run osmo-hlr_10.42.42.2(pid=28786): Launched 10:25:13.909270 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:14.438683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28788): Launched 10:25:14.743338 run osmo-stp_10.42.42.5(pid=28789): Launched 10:25:14.859661 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:15.409983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28791): Launched 10:25:15.713268 run osmo-msc_10.42.42.6(pid=28792): Launched 10:25:15.956693 run osmo-stp_10.42.42.5(pid=28789): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28789)] 10:25:16.124203 run osmo-stp_10.42.42.5(pid=28789): stdout: | (launched: 2022-12-10_10:25:14.688447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:16.363084 run osmo-stp_10.42.42.5(pid=28789): stderr: | 20221210102514859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102514859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102514859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102514860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102514860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102514860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102514860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:16.504103 run osmo-stp_10.42.42.5(pid=28789): stdout: | (launched: 2022-12-10_10:25:14.688447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:16.639363 run osmo-stp_10.42.42.5(pid=28789): stderr: | 20221210102514859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102514859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102514859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102514860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102514860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102514860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102514860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:16.800723 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28789): Process ended prematurely: osmo-stp_10.42.42.5(pid=28789) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28789)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:25:16.811331 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:25:16.843141 run osmo-hlr_10.42.42.2(pid=28786): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28786)] 10:25:16.896368 run osmo-hlr_10.42.42.2(pid=28786): stdout: | (launched: 2022-12-10_10:25:13.737689) 10:25:16.951917 run osmo-hlr_10.42.42.2(pid=28786): stderr: | 20221210102513913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102513913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102513913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102513913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102513913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102513913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102513926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102513936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102513936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102513937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:17.028039 run osmo-msc_10.42.42.6(pid=28792): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28792)] 10:25:17.081095 run osmo-msc_10.42.42.6(pid=28792): stdout: | (launched: 2022-12-10_10:25:15.658342) 10:25:17.136387 run osmo-msc_10.42.42.6(pid=28792): stderr: | 20221210102515985 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102515985 DLGLOBAL DEBUG validating counter group 0x7f260b220c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102515985 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102515986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102515986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102515986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102515988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102515988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102515988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102515988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:17.191259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28785): Terminating (SIGTERM) 10:25:17.234150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28788): Terminating (SIGTERM) 10:25:17.277416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28791): Terminating (SIGTERM) 10:25:17.320645 --- ParallelTerminationStrategy: PID 28785 died... 10:25:17.340909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28785): Terminated: ok {rc=0} 10:25:17.388903 --- ParallelTerminationStrategy: PID 28788 died... 10:25:17.408835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28788): Terminated: ok {rc=0} 10:25:17.456417 --- ParallelTerminationStrategy: PID 28791 died... 10:25:17.476354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28791): Terminated: ok {rc=0} 10:25:17.566185 bus /sierra_3: Setting Powered False 10:25:18.664468 bus /sierra_3: Setting Powered False 10:25:19.778588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:25:21.023228 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:21.029705 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:25:21.061855 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:25:21.088677 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:25:21.144124 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:25:21.178320 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:25:21.206170 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:25:21.751869 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:25:21.800823 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:21.812186 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:25:21.881409 tst mo_mt_call.py: using LAC 27744 10:25:22.001131 tst mo_mt_call.py: using RAC 204 10:25:22.119983 tst mo_mt_call.py: using CellId 27744 10:25:22.241211 tst mo_mt_call.py: using BVCI 27745 10:25:22.352390 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:22.363459 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:22.374490 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:22.385428 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:22.396367 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:22.407229 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:22.526849 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:22.646633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:23.118891 run create_hlr_db(pid=28798): Launched 10:25:23.243188 bus /sierra_2: Setting Powered False 10:25:24.303412 run create_hlr_db(pid=28798): Terminated: ok {rc=0} 10:25:24.747792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28800): Launched 10:25:25.072058 run osmo-hlr_10.42.42.2(pid=28801): Launched 10:25:25.196635 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:25.760707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28803): Launched 10:25:26.085565 run osmo-stp_10.42.42.5(pid=28804): Launched 10:25:26.211240 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:26.802568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28806): Launched 10:25:27.127754 run osmo-msc_10.42.42.6(pid=28807): Launched 10:25:27.309548 run osmo-stp_10.42.42.5(pid=28804): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28804)] 10:25:27.446625 run osmo-stp_10.42.42.5(pid=28804): stdout: | (launched: 2022-12-10_10:25:26.027131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:27.584472 run osmo-stp_10.42.42.5(pid=28804): stderr: | 20221210102526220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102526221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102526221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102526221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102526222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102526222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102526222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:27.721265 run osmo-stp_10.42.42.5(pid=28804): stdout: | (launched: 2022-12-10_10:25:26.027131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:27.850726 run osmo-stp_10.42.42.5(pid=28804): stderr: | 20221210102526220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102526221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102526221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102526221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102526222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102526222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102526222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:28.005532 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28804): Process ended prematurely: osmo-stp_10.42.42.5(pid=28804) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28804)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:25:28.014990 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:25:28.043501 run osmo-hlr_10.42.42.2(pid=28801): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28801)] 10:25:28.094277 run osmo-hlr_10.42.42.2(pid=28801): stdout: | (launched: 2022-12-10_10:25:25.014024) 10:25:28.146696 run osmo-hlr_10.42.42.2(pid=28801): stderr: | 20221210102525213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102525213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102525213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102525213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102525213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102525213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102525226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102525234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102525235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102525235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:28.219924 run osmo-msc_10.42.42.6(pid=28807): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28807)] 10:25:28.270506 run osmo-msc_10.42.42.6(pid=28807): stdout: | (launched: 2022-12-10_10:25:27.069183) 10:25:28.322885 run osmo-msc_10.42.42.6(pid=28807): stderr: | 20221210102527391 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102527391 DLGLOBAL DEBUG validating counter group 0x7f3049bdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102527391 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102527391 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102527391 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102527392 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102527393 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102527394 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102527394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102527394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:28.375447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28800): Terminating (SIGTERM) 10:25:28.417490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28803): Terminating (SIGTERM) 10:25:28.459612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28806): Terminating (SIGTERM) 10:25:28.502244 --- ParallelTerminationStrategy: PID 28800 died... 10:25:28.522286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28800): Terminated: ok {rc=0} 10:25:28.569430 --- ParallelTerminationStrategy: PID 28803 died... 10:25:28.589148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28803): Terminated: ok {rc=0} 10:25:28.636193 --- ParallelTerminationStrategy: PID 28806 died... 10:25:28.656119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28806): Terminated: ok {rc=0} 10:25:28.744584 bus /sierra_3: Setting Powered False 10:25:29.844274 bus /sierra_3: Setting Powered False 10:25:30.978462 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:25:32.155210 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:32.169135 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:25:32.241226 tst mo_mt_call_osmux.py: using LAC 27745 10:25:32.369184 tst mo_mt_call_osmux.py: using RAC 205 10:25:32.495910 tst mo_mt_call_osmux.py: using CellId 27745 10:25:32.623489 tst mo_mt_call_osmux.py: using BVCI 27746 10:25:32.744697 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:32.756373 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:32.767794 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:32.779395 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:32.791160 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:25:32.802626 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:32.919735 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:25:33.037613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:33.542573 run create_hlr_db(pid=28809): Launched 10:25:33.666580 bus /sierra_2: Setting Powered False 10:25:34.730732 run create_hlr_db(pid=28809): Terminated: ok {rc=0} 10:25:35.164686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28811): Launched 10:25:35.469125 run osmo-hlr_10.42.42.2(pid=28812): Launched 10:25:35.586774 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:36.127460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28814): Launched 10:25:36.431226 run osmo-stp_10.42.42.5(pid=28815): Launched 10:25:36.548284 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:37.098170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28817): Launched 10:25:37.401968 run osmo-msc_10.42.42.6(pid=28818): Launched 10:25:37.573850 run osmo-stp_10.42.42.5(pid=28815): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28815)] 10:25:37.703785 run osmo-stp_10.42.42.5(pid=28815): stdout: | (launched: 2022-12-10_10:25:36.376094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:37.832790 run osmo-stp_10.42.42.5(pid=28815): stderr: | 20221210102536547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102536548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102536548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102536548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102536549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102536549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102536549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:37.959058 run osmo-stp_10.42.42.5(pid=28815): stdout: | (launched: 2022-12-10_10:25:36.376094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:38.079178 run osmo-stp_10.42.42.5(pid=28815): stderr: | 20221210102536547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102536548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102536548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102536548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102536549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102536549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102536549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:38.223239 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28815): Process ended prematurely: osmo-stp_10.42.42.5(pid=28815) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28815)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:25:38.232131 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:25:38.258596 run osmo-hlr_10.42.42.2(pid=28812): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28812)] 10:25:38.306180 run osmo-hlr_10.42.42.2(pid=28812): stdout: | (launched: 2022-12-10_10:25:35.413928) 10:25:38.355181 run osmo-hlr_10.42.42.2(pid=28812): stderr: | 20221210102535593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102535593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102535593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102535593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102535593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102535593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102535605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102535615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102535616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102535616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:38.423695 run osmo-msc_10.42.42.6(pid=28818): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28818)] 10:25:38.471107 run osmo-msc_10.42.42.6(pid=28818): stdout: | (launched: 2022-12-10_10:25:37.346701) 10:25:38.520244 run osmo-msc_10.42.42.6(pid=28818): stderr: | 20221210102537618 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102537618 DLGLOBAL DEBUG validating counter group 0x7ff1d281ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102537618 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102537619 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102537619 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102537619 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102537621 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102537621 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102537621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102537621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:38.569649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28811): Terminating (SIGTERM) 10:25:38.609405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28814): Terminating (SIGTERM) 10:25:38.649208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28817): Terminating (SIGTERM) 10:25:38.689375 --- ParallelTerminationStrategy: PID 28811 died... 10:25:38.708738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28811): Terminated: ok {rc=0} 10:25:38.752733 --- ParallelTerminationStrategy: PID 28814 died... 10:25:38.771180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28814): Terminated: ok {rc=0} 10:25:38.815042 --- ParallelTerminationStrategy: PID 28817 died... 10:25:38.833836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28817): Terminated: ok {rc=0} 10:25:38.920008 bus /sierra_3: Setting Powered False 10:25:40.020371 bus /sierra_3: Setting Powered False 10:25:41.135426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:25:42.380222 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:25:42.386568 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:25:42.418985 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:25:42.445627 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:25:42.498401 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:25:42.532118 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:25:42.559780 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:25:43.110770 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:25:43.163899 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:43.175462 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:25:43.245360 tst mo_mt_call.py: using LAC 27746 10:25:43.373638 tst mo_mt_call.py: using RAC 206 10:25:43.494656 tst mo_mt_call.py: using CellId 27746 10:25:43.616388 tst mo_mt_call.py: using BVCI 27747 10:25:43.727770 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:43.738966 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:43.749987 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:43.761547 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:43.773194 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:43.784500 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:43.898961 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:44.016321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:44.519476 run create_hlr_db(pid=28824): Launched 10:25:44.644654 bus /sierra_2: Setting Powered False 10:25:45.709506 run create_hlr_db(pid=28824): Terminated: ok {rc=0} 10:25:46.189051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Launched 10:25:46.523921 run osmo-hlr_10.42.42.2(pid=28827): Launched 10:25:46.776722 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:47.426623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Launched 10:25:47.754063 run osmo-stp_10.42.42.5(pid=28830): Launched 10:25:47.879022 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:48.466709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28832): Launched 10:25:48.791381 run osmo-msc_10.42.42.6(pid=28833): Launched 10:25:48.973288 run osmo-stp_10.42.42.5(pid=28830): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] 10:25:49.110296 run osmo-stp_10.42.42.5(pid=28830): stdout: | (launched: 2022-12-10_10:25:47.695676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:49.248914 run osmo-stp_10.42.42.5(pid=28830): stderr: | 20221210102547886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102547886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102547887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102547887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102547887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102547887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102547887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:49.385869 run osmo-stp_10.42.42.5(pid=28830): stdout: | (launched: 2022-12-10_10:25:47.695676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:49.514849 run osmo-stp_10.42.42.5(pid=28830): stderr: | 20221210102547886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102547886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102547887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102547887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102547887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102547887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102547887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:49.669247 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28830): Process ended prematurely: osmo-stp_10.42.42.5(pid=28830) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:25:49.678802 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:25:49.707379 run osmo-hlr_10.42.42.2(pid=28827): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28827)] 10:25:49.758007 run osmo-hlr_10.42.42.2(pid=28827): stdout: | (launched: 2022-12-10_10:25:46.460862) 10:25:49.810261 run osmo-hlr_10.42.42.2(pid=28827): stderr: | 20221210102546770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102546770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102546770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102546770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102546771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102546771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102546787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102546795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102546795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102546795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:25:49.882994 run osmo-msc_10.42.42.6(pid=28833): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28833)] 10:25:49.933719 run osmo-msc_10.42.42.6(pid=28833): stdout: | (launched: 2022-12-10_10:25:48.732902) 10:25:49.985864 run osmo-msc_10.42.42.6(pid=28833): stderr: | 20221210102549053 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102549053 DLGLOBAL DEBUG validating counter group 0x7f1aeacb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102549053 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102549053 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102549054 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102549054 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102549055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102549056 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102549056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102549056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:25:50.038280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Terminating (SIGTERM) 10:25:50.080595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Terminating (SIGTERM) 10:25:50.123074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28832): Terminating (SIGTERM) 10:25:50.165944 --- ParallelTerminationStrategy: PID 28826 died... 10:25:50.186034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Terminated: ok {rc=0} 10:25:50.233176 --- ParallelTerminationStrategy: PID 28829 died... 10:25:50.252684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Terminated: ok {rc=0} 10:25:50.299627 --- ParallelTerminationStrategy: PID 28832 died... 10:25:50.319356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28832): Terminated: ok {rc=0} 10:25:50.408881 bus /sierra_3: Setting Powered False 10:25:51.509693 bus /sierra_3: Setting Powered False 10:25:52.626782 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:25:53.778798 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:53.791058 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:25:53.864647 tst mo_mt_call_osmux.py: using LAC 27747 10:25:53.990834 tst mo_mt_call_osmux.py: using RAC 207 10:25:54.117318 tst mo_mt_call_osmux.py: using CellId 27747 10:25:54.245619 tst mo_mt_call_osmux.py: using BVCI 27748 10:25:54.356727 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:54.368033 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:54.379205 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:54.390386 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:54.401478 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:25:54.412552 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:54.527535 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:25:54.647852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:25:55.149802 run create_hlr_db(pid=28835): Launched 10:25:55.275566 bus /sierra_2: Setting Powered False 10:25:56.339757 run create_hlr_db(pid=28835): Terminated: ok {rc=0} 10:25:56.773529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28837): Launched 10:25:57.080517 run osmo-hlr_10.42.42.2(pid=28838): Launched 10:25:57.197757 run osmo-stp_10.42.42.5: Starting osmo-stp 10:25:57.737065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28840): Launched 10:25:58.040662 run osmo-stp_10.42.42.5(pid=28841): Launched 10:25:58.156406 run osmo-msc_10.42.42.6: Starting osmo-msc 10:25:58.707002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28843): Launched 10:25:59.013561 run osmo-msc_10.42.42.6(pid=28844): Launched 10:25:59.184743 run osmo-stp_10.42.42.5(pid=28841): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28841)] 10:25:59.313881 run osmo-stp_10.42.42.5(pid=28841): stdout: | (launched: 2022-12-10_10:25:57.985124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:59.447089 run osmo-stp_10.42.42.5(pid=28841): stderr: | 20221210102558158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102558158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102558158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102558159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102558159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102558159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102558159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:59.574311 run osmo-stp_10.42.42.5(pid=28841): stdout: | (launched: 2022-12-10_10:25:57.985124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:25:59.695476 run osmo-stp_10.42.42.5(pid=28841): stderr: | 20221210102558158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102558158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102558158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102558159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102558159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102558159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102558159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:25:59.840180 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28841): Process ended prematurely: osmo-stp_10.42.42.5(pid=28841) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28841)] [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:25:59.849024 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:25:59.875517 run osmo-hlr_10.42.42.2(pid=28838): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28838)] 10:25:59.923240 run osmo-hlr_10.42.42.2(pid=28838): stdout: | (launched: 2022-12-10_10:25:57.024755) 10:25:59.972499 run osmo-hlr_10.42.42.2(pid=28838): stderr: | 20221210102557202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102557202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102557202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102557202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102557203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102557203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102557215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102557224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102557224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102557224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:00.041714 run osmo-msc_10.42.42.6(pid=28844): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28844)] 10:26:00.089293 run osmo-msc_10.42.42.6(pid=28844): stdout: | (launched: 2022-12-10_10:25:58.958024) 10:26:00.138555 run osmo-msc_10.42.42.6(pid=28844): stderr: | 20221210102559231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102559231 DLGLOBAL DEBUG validating counter group 0x7f3f4c120c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102559231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102559231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102559231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102559232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102559233 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102559234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102559234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102559234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:00.188080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28837): Terminating (SIGTERM) 10:26:00.227634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28840): Terminating (SIGTERM) 10:26:00.267365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28843): Terminating (SIGTERM) 10:26:00.307460 --- ParallelTerminationStrategy: PID 28837 died... 10:26:00.326628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28837): Terminated: ok {rc=0} 10:26:00.370734 --- ParallelTerminationStrategy: PID 28840 died... 10:26:00.389425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28840): Terminated: ok {rc=0} 10:26:00.433350 --- ParallelTerminationStrategy: PID 28843 died... 10:26:00.451994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28843): Terminated: ok {rc=0} 10:26:00.538722 bus /sierra_3: Setting Powered False 10:26:01.639041 bus /sierra_3: Setting Powered False 10:26:02.780129 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:26:04.035114 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:04.041389 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:26:04.073786 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:26:04.100336 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:26:04.151886 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:26:04.183897 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:26:04.210251 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:26:04.763620 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:26:04.812133 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:04.823311 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:26:04.892358 tst mo_mt_call.py: using LAC 27748 10:26:05.013075 tst mo_mt_call.py: using RAC 208 10:26:05.133031 tst mo_mt_call.py: using CellId 27748 10:26:05.255479 tst mo_mt_call.py: using BVCI 27749 10:26:05.365351 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:05.376340 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:05.387375 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:05.398323 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:05.409285 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:05.420096 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:26:05.538387 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:26:05.656729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:06.127081 run create_hlr_db(pid=28849): Launched 10:26:06.251272 bus /sierra_2: Setting Powered False 10:26:07.312020 run create_hlr_db(pid=28849): Terminated: ok {rc=0} 10:26:07.736465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28851): Launched 10:26:08.041093 run osmo-hlr_10.42.42.2(pid=28852): Launched 10:26:08.157061 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:08.696833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28854): Launched 10:26:09.000891 run osmo-stp_10.42.42.5(pid=28855): Launched 10:26:09.117201 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:09.665915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28857): Launched 10:26:09.969739 run osmo-msc_10.42.42.6(pid=28858): Launched 10:26:10.139982 run osmo-stp_10.42.42.5(pid=28855): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28855)] 10:26:10.268546 run osmo-stp_10.42.42.5(pid=28855): stdout: | (launched: 2022-12-10_10:26:08.945118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:10.397135 run osmo-stp_10.42.42.5(pid=28855): stderr: | 20221210102609114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102609114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102609115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102609115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102609117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102609117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102609117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:10.523597 run osmo-stp_10.42.42.5(pid=28855): stdout: | (launched: 2022-12-10_10:26:08.945118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:10.644058 run osmo-stp_10.42.42.5(pid=28855): stderr: | 20221210102609114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102609114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102609115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102609115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102609117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102609117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102609117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:10.788001 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28855): Process ended prematurely: osmo-stp_10.42.42.5(pid=28855) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28855)] [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:26:10.796778 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:26:10.823159 run osmo-hlr_10.42.42.2(pid=28852): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28852)] 10:26:10.870425 run osmo-hlr_10.42.42.2(pid=28852): stdout: | (launched: 2022-12-10_10:26:07.985877) 10:26:10.919540 run osmo-hlr_10.42.42.2(pid=28852): stderr: | 20221210102608164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102608164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102608164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102608164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102608164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102608164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102608176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102608185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102608185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102608185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:10.988996 run osmo-msc_10.42.42.6(pid=28858): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28858)] 10:26:11.036302 run osmo-msc_10.42.42.6(pid=28858): stdout: | (launched: 2022-12-10_10:26:09.914637) 10:26:11.085353 run osmo-msc_10.42.42.6(pid=28858): stderr: | 20221210102610187 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102610187 DLGLOBAL DEBUG validating counter group 0x7fdbfdf1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102610187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102610187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102610188 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102610188 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102610190 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102610190 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102610190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102610190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:11.134889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28851): Terminating (SIGTERM) 10:26:11.174376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28854): Terminating (SIGTERM) 10:26:11.213877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28857): Terminating (SIGTERM) 10:26:11.253674 --- ParallelTerminationStrategy: PID 28851 died... 10:26:11.272569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28851): Terminated: ok {rc=0} 10:26:11.316509 --- ParallelTerminationStrategy: PID 28854 died... 10:26:11.335269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28854): Terminated: ok {rc=0} 10:26:11.379145 --- ParallelTerminationStrategy: PID 28857 died... 10:26:11.397980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28857): Terminated: ok {rc=0} 10:26:11.484108 bus /sierra_3: Setting Powered False 10:26:12.585029 bus /sierra_3: Setting Powered False 10:26:13.702295 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:26:14.849060 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:14.860870 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:26:14.930298 tst mo_mt_call_osmux.py: using LAC 27749 10:26:15.067331 tst mo_mt_call_osmux.py: using RAC 209 10:26:15.206265 tst mo_mt_call_osmux.py: using CellId 27749 10:26:15.334939 tst mo_mt_call_osmux.py: using BVCI 27750 10:26:15.453557 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:15.465513 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:15.477269 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:15.489432 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:15.501435 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:26:15.513424 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:26:15.633075 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:26:15.754392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:16.283032 run create_hlr_db(pid=28860): Launched 10:26:16.444286 bus /sierra_2: Setting Powered False 10:26:17.504556 run create_hlr_db(pid=28860): Terminated: ok {rc=0} 10:26:17.948444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28862): Launched 10:26:18.273734 run osmo-hlr_10.42.42.2(pid=28863): Launched 10:26:18.398282 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:18.960198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28865): Launched 10:26:19.285948 run osmo-stp_10.42.42.5(pid=28866): Launched 10:26:19.410592 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:19.998096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28868): Launched 10:26:20.324306 run osmo-msc_10.42.42.6(pid=28869): Launched 10:26:20.506242 run osmo-stp_10.42.42.5(pid=28866): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28866)] 10:26:20.643937 run osmo-stp_10.42.42.5(pid=28866): stdout: | (launched: 2022-12-10_10:26:19.227571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:20.782332 run osmo-stp_10.42.42.5(pid=28866): stderr: | 20221210102619420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102619421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102619421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102619421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102619422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102619422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102619422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:20.919629 run osmo-stp_10.42.42.5(pid=28866): stdout: | (launched: 2022-12-10_10:26:19.227571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:21.049433 run osmo-stp_10.42.42.5(pid=28866): stderr: | 20221210102619420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102619421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102619421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102619421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102619422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102619422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102619422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:21.205195 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28866): Process ended prematurely: osmo-stp_10.42.42.5(pid=28866) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28866)] [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:26:21.214883 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:26:21.243657 run osmo-hlr_10.42.42.2(pid=28863): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28863)] 10:26:21.294322 run osmo-hlr_10.42.42.2(pid=28863): stdout: | (launched: 2022-12-10_10:26:18.215369) 10:26:21.346514 run osmo-hlr_10.42.42.2(pid=28863): stderr: | 20221210102618413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102618413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102618413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102618413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102618414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102618414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102618426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102618434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102618434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102618434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:21.419404 run osmo-msc_10.42.42.6(pid=28869): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28869)] 10:26:21.469876 run osmo-msc_10.42.42.6(pid=28869): stdout: | (launched: 2022-12-10_10:26:20.265735) 10:26:21.522041 run osmo-msc_10.42.42.6(pid=28869): stderr: | 20221210102620588 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102620588 DLGLOBAL DEBUG validating counter group 0x7f1b00d52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102620588 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102620588 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102620588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102620589 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102620590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102620591 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102620591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102620591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:21.574507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28862): Terminating (SIGTERM) 10:26:21.617203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28865): Terminating (SIGTERM) 10:26:21.659787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28868): Terminating (SIGTERM) 10:26:21.702518 --- ParallelTerminationStrategy: PID 28862 died... 10:26:21.722796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28862): Terminated: ok {rc=0} 10:26:21.770230 --- ParallelTerminationStrategy: PID 28865 died... 10:26:21.790114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28865): Terminated: ok {rc=0} 10:26:21.837153 --- ParallelTerminationStrategy: PID 28868 died... 10:26:21.856932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28868): Terminated: ok {rc=0} 10:26:21.946508 bus /sierra_3: Setting Powered False 10:26:23.046446 bus /sierra_3: Setting Powered False 10:26:24.165601 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:26:25.422305 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:25.428434 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:26:25.463311 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:26:25.491439 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:26:25.546207 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:26:25.578920 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:26:25.605494 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:26:26.153418 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:26:26.202105 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:26.213199 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:26:26.283008 tst mo_mt_call.py: using LAC 27750 10:26:26.402632 tst mo_mt_call.py: using RAC 210 10:26:26.523352 tst mo_mt_call.py: using CellId 27750 10:26:26.642244 tst mo_mt_call.py: using BVCI 27751 10:26:26.753449 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:26.764252 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:26.774993 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:26.785812 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:26.796515 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:26.807303 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:26.925942 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:27.044628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:27.547623 run create_hlr_db(pid=28874): Launched 10:26:27.673025 bus /sierra_2: Setting Powered False 10:26:28.737648 run create_hlr_db(pid=28874): Terminated: ok {rc=0} 10:26:29.190054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28876): Launched 10:26:29.516169 run osmo-hlr_10.42.42.2(pid=28877): Launched 10:26:29.641667 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:30.204076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28879): Launched 10:26:30.529404 run osmo-stp_10.42.42.5(pid=28880): Launched 10:26:30.654921 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:31.262845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28882): Launched 10:26:31.623892 run osmo-msc_10.42.42.6(pid=28883): Launched 10:26:31.851759 run osmo-stp_10.42.42.5(pid=28880): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28880)] 10:26:32.011749 run osmo-stp_10.42.42.5(pid=28880): stdout: | (launched: 2022-12-10_10:26:30.470934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:32.256103 run osmo-stp_10.42.42.5(pid=28880): stderr: | 20221210102630663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102630663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102630663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102630663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102630664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102630664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102630664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:32.485461 run osmo-stp_10.42.42.5(pid=28880): stdout: | (launched: 2022-12-10_10:26:30.470934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:32.624704 run osmo-stp_10.42.42.5(pid=28880): stderr: | 20221210102630663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102630663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102630663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102630663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102630664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102630664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102630664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:32.779910 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28880): Process ended prematurely: osmo-stp_10.42.42.5(pid=28880) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28880)] [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:26:32.789653 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 10:26:32.818748 run osmo-hlr_10.42.42.2(pid=28877): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28877)] 10:26:32.869795 run osmo-hlr_10.42.42.2(pid=28877): stdout: | (launched: 2022-12-10_10:26:29.457557) 10:26:32.922901 run osmo-hlr_10.42.42.2(pid=28877): stderr: | 20221210102629658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102629658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102629658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102629658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102629658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102629658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102629670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102629678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102629678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102629679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:32.996730 run osmo-msc_10.42.42.6(pid=28883): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28883)] 10:26:33.048317 run osmo-msc_10.42.42.6(pid=28883): stdout: | (launched: 2022-12-10_10:26:31.553115) 10:26:33.101491 run osmo-msc_10.42.42.6(pid=28883): stderr: | 20221210102632181 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102632181 DLGLOBAL DEBUG validating counter group 0x7f78a7ad1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102632181 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102632181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102632181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102632182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102632183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102632184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102632184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102632184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:33.155259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28876): Terminating (SIGTERM) 10:26:33.198536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28879): Terminating (SIGTERM) 10:26:33.241460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28882): Terminating (SIGTERM) 10:26:33.284660 --- ParallelTerminationStrategy: PID 28876 died... 10:26:33.304723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28876): Terminated: ok {rc=0} 10:26:33.352449 --- ParallelTerminationStrategy: PID 28879 died... 10:26:33.372307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28879): Terminated: ok {rc=0} 10:26:33.419681 --- ParallelTerminationStrategy: PID 28882 died... 10:26:33.439682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28882): Terminated: ok {rc=0} 10:26:33.529717 bus /sierra_3: Setting Powered False 10:26:34.629107 bus /sierra_3: Setting Powered False 10:26:35.746481 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:26:36.896674 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:36.909179 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:26:36.983000 tst mo_mt_call_osmux.py: using LAC 27751 10:26:37.111498 tst mo_mt_call_osmux.py: using RAC 211 10:26:37.239960 tst mo_mt_call_osmux.py: using CellId 27751 10:26:37.367675 tst mo_mt_call_osmux.py: using BVCI 27752 10:26:37.485981 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:37.497575 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:37.508740 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:37.520437 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:37.532089 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:26:37.544326 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:37.662476 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:26:37.781276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:38.286586 run create_hlr_db(pid=28885): Launched 10:26:38.411340 bus /sierra_2: Setting Powered False 10:26:39.475824 run create_hlr_db(pid=28885): Terminated: ok {rc=0} 10:26:39.912491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28887): Launched 10:26:40.217106 run osmo-hlr_10.42.42.2(pid=28888): Launched 10:26:40.335982 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:40.860207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28890): Launched 10:26:41.164597 run osmo-stp_10.42.42.5(pid=28891): Launched 10:26:41.280450 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:41.835935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28893): Launched 10:26:42.142374 run osmo-msc_10.42.42.6(pid=28894): Launched 10:26:42.312107 run osmo-stp_10.42.42.5(pid=28891): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28891)] 10:26:42.440425 run osmo-stp_10.42.42.5(pid=28891): stdout: | (launched: 2022-12-10_10:26:41.109245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:42.569333 run osmo-stp_10.42.42.5(pid=28891): stderr: | 20221210102641282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102641282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102641283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102641283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102641283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102641283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102641284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:42.695685 run osmo-stp_10.42.42.5(pid=28891): stdout: | (launched: 2022-12-10_10:26:41.109245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:42.815988 run osmo-stp_10.42.42.5(pid=28891): stderr: | 20221210102641282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102641282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102641283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102641283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102641283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102641283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102641284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:42.960572 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28891): Process ended prematurely: osmo-stp_10.42.42.5(pid=28891) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28891)] [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:26:42.969542 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:26:42.996191 run osmo-hlr_10.42.42.2(pid=28888): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28888)] 10:26:43.044051 run osmo-hlr_10.42.42.2(pid=28888): stdout: | (launched: 2022-12-10_10:26:40.161667) 10:26:43.093517 run osmo-hlr_10.42.42.2(pid=28888): stderr: | 20221210102640338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102640338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102640338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102640338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102640338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102640338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102640350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102640358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102640358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102640358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:43.162824 run osmo-msc_10.42.42.6(pid=28894): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28894)] 10:26:43.210978 run osmo-msc_10.42.42.6(pid=28894): stdout: | (launched: 2022-12-10_10:26:42.086645) 10:26:43.260692 run osmo-msc_10.42.42.6(pid=28894): stderr: | 20221210102642360 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102642360 DLGLOBAL DEBUG validating counter group 0x7f6d4829bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102642360 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102642360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102642360 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102642360 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102642363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102642364 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102642364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102642364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:43.310532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28887): Terminating (SIGTERM) 10:26:43.350613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28890): Terminating (SIGTERM) 10:26:43.390429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28893): Terminating (SIGTERM) 10:26:43.430455 --- ParallelTerminationStrategy: PID 28887 died... 10:26:43.449689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28887): Terminated: ok {rc=0} 10:26:43.493975 --- ParallelTerminationStrategy: PID 28890 died... 10:26:43.512766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28890): Terminated: ok {rc=0} 10:26:43.556722 --- ParallelTerminationStrategy: PID 28893 died... 10:26:43.575496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28893): Terminated: ok {rc=0} 10:26:43.659817 bus /sierra_3: Setting Powered False 10:26:44.754828 bus /sierra_3: Setting Powered False 10:26:45.875203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:26:47.145296 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:26:47.151582 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:26:47.184902 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:26:47.212099 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:26:47.268124 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:26:47.303806 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:26:47.331506 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:26:47.876118 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:26:47.925008 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:47.936506 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:26:47.993629 tst mo_mt_call.py: using LAC 27752 10:26:48.122316 tst mo_mt_call.py: using RAC 212 10:26:48.249389 tst mo_mt_call.py: using CellId 27752 10:26:48.375432 tst mo_mt_call.py: using BVCI 27753 10:26:48.493916 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:48.505915 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:48.517771 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:48.529829 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:48.542333 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:48.554656 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:26:48.672036 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:26:48.788077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:49.260553 run create_hlr_db(pid=28899): Launched 10:26:49.385349 bus /sierra_2: Setting Powered False 10:26:50.446159 run create_hlr_db(pid=28899): Terminated: ok {rc=0} 10:26:50.889898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Launched 10:26:51.215518 run osmo-hlr_10.42.42.2(pid=28902): Launched 10:26:51.339985 run osmo-stp_10.42.42.5: Starting osmo-stp 10:26:51.901701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Launched 10:26:52.226283 run osmo-stp_10.42.42.5(pid=28905): Launched 10:26:52.350786 run osmo-msc_10.42.42.6: Starting osmo-msc 10:26:52.936248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28907): Launched 10:26:53.261511 run osmo-msc_10.42.42.6(pid=28908): Launched 10:26:53.443619 run osmo-stp_10.42.42.5(pid=28905): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] 10:26:53.581560 run osmo-stp_10.42.42.5(pid=28905): stdout: | (launched: 2022-12-10_10:26:52.167452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:53.719694 run osmo-stp_10.42.42.5(pid=28905): stderr: | 20221210102652359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102652359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102652359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102652361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102652361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102652361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102652361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:53.857309 run osmo-stp_10.42.42.5(pid=28905): stdout: | (launched: 2022-12-10_10:26:52.167452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:26:53.986920 run osmo-stp_10.42.42.5(pid=28905): stderr: | 20221210102652359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102652359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102652359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102652361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102652361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102652361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102652361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:26:54.141924 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28905): Process ended prematurely: osmo-stp_10.42.42.5(pid=28905) [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:26:54.151596 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:26:54.179797 run osmo-hlr_10.42.42.2(pid=28902): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28902)] 10:26:54.230825 run osmo-hlr_10.42.42.2(pid=28902): stdout: | (launched: 2022-12-10_10:26:51.156819) 10:26:54.282886 run osmo-hlr_10.42.42.2(pid=28902): stderr: | 20221210102651356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102651356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102651356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102651356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102651356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102651356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102651369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102651377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102651377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102651377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:26:54.355553 run osmo-msc_10.42.42.6(pid=28908): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28908)] 10:26:54.405677 run osmo-msc_10.42.42.6(pid=28908): stdout: | (launched: 2022-12-10_10:26:53.202988) 10:26:54.457385 run osmo-msc_10.42.42.6(pid=28908): stderr: | 20221210102653525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102653525 DLGLOBAL DEBUG validating counter group 0x7fc36f7b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102653525 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102653525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102653525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102653526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102653527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102653528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102653528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102653528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:26:54.509685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Terminating (SIGTERM) 10:26:54.551736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Terminating (SIGTERM) 10:26:54.593937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28907): Terminating (SIGTERM) 10:26:54.636513 --- ParallelTerminationStrategy: PID 28901 died... 10:26:54.656608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Terminated: ok {rc=0} 10:26:54.703564 --- ParallelTerminationStrategy: PID 28904 died... 10:26:54.723199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Terminated: ok {rc=0} 10:26:54.770171 --- ParallelTerminationStrategy: PID 28907 died... 10:26:54.789709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28907): Terminated: ok {rc=0} 10:26:54.877286 bus /sierra_3: Setting Powered False 10:26:55.977080 bus /sierra_3: Setting Powered False 10:26:57.093952 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:26:58.244058 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:58.256634 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:26:58.311547 tst mo_mt_call_osmux.py: using LAC 27753 10:26:58.439441 tst mo_mt_call_osmux.py: using RAC 213 10:26:58.566393 tst mo_mt_call_osmux.py: using CellId 27753 10:26:58.692391 tst mo_mt_call_osmux.py: using BVCI 27754 10:26:58.810423 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:58.822233 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:58.833831 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:58.845707 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:58.857642 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:26:58.869466 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:26:58.988437 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:26:59.105841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:26:59.580104 run create_hlr_db(pid=28910): Launched 10:26:59.705119 bus /sierra_2: Setting Powered False 10:27:00.766514 run create_hlr_db(pid=28910): Terminated: ok {rc=0} 10:27:01.219632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28912): Launched 10:27:01.585778 run osmo-hlr_10.42.42.2(pid=28913): Launched 10:27:01.812674 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:02.380659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28915): Launched 10:27:02.685854 run osmo-stp_10.42.42.5(pid=28916): Launched 10:27:02.802884 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:03.372710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28918): Launched 10:27:03.678205 run osmo-msc_10.42.42.6(pid=28919): Launched 10:27:03.849447 run osmo-stp_10.42.42.5(pid=28916): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28916)] 10:27:03.978600 run osmo-stp_10.42.42.5(pid=28916): stdout: | (launched: 2022-12-10_10:27:02.630773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:04.108246 run osmo-stp_10.42.42.5(pid=28916): stderr: | 20221210102702803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102702803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102702803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102702804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102702804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102702804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102702804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:04.236144 run osmo-stp_10.42.42.5(pid=28916): stdout: | (launched: 2022-12-10_10:27:02.630773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:04.358225 run osmo-stp_10.42.42.5(pid=28916): stderr: | 20221210102702803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102702803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102702803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102702804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102702804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102702804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102702804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:04.504194 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28916): Process ended prematurely: osmo-stp_10.42.42.5(pid=28916) [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28916)] [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:27:04.513238 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:27:04.540242 run osmo-hlr_10.42.42.2(pid=28913): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28913)] 10:27:04.588670 run osmo-hlr_10.42.42.2(pid=28913): stdout: | (launched: 2022-12-10_10:27:01.515351) 10:27:04.638670 run osmo-hlr_10.42.42.2(pid=28913): stderr: | 20221210102701894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102701895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102701895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102701895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102701895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102701895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102701921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102701940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102701940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102701940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:04.708166 run osmo-msc_10.42.42.6(pid=28919): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28919)] 10:27:04.755973 run osmo-msc_10.42.42.6(pid=28919): stdout: | (launched: 2022-12-10_10:27:03.622544) 10:27:04.805599 run osmo-msc_10.42.42.6(pid=28919): stderr: | 20221210102703895 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102703895 DLGLOBAL DEBUG validating counter group 0x7fcbc10e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102703895 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102703896 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102703896 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102703896 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102703898 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102703899 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102703899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102703899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:04.855708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28912): Terminating (SIGTERM) 10:27:04.895554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28915): Terminating (SIGTERM) 10:27:04.935584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28918): Terminating (SIGTERM) 10:27:04.976100 --- ParallelTerminationStrategy: PID 28912 died... 10:27:04.995368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28912): Terminated: ok {rc=0} 10:27:05.039990 --- ParallelTerminationStrategy: PID 28915 died... 10:27:05.058883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28915): Terminated: ok {rc=0} 10:27:05.103226 --- ParallelTerminationStrategy: PID 28918 died... 10:27:05.122142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28918): Terminated: ok {rc=0} 10:27:05.208886 bus /sierra_3: Setting Powered False 10:27:06.309792 bus /sierra_3: Setting Powered False 10:27:07.423665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:trx-umtrx --------------------------------------------------------------------- 10:27:08.681595 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:08.686527 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:27:08.721281 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 10:27:08.749263 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:27:08.834507 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:27:08.868321 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 10:27:08.895987 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:27:09.482841 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 10:27:09.488221 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:09.499537 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:27:09.549747 tst emergency_mo_mt_call.py: using LAC 27754 10:27:09.674259 tst emergency_mo_mt_call.py: using RAC 214 10:27:09.799710 tst emergency_mo_mt_call.py: using CellId 27754 10:27:09.926450 tst emergency_mo_mt_call.py: using BVCI 27755 10:27:10.044237 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:10.055575 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:10.066682 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:10.078177 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:10.089329 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:10.100630 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:10.215837 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:10.331959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:10.798521 run create_hlr_db(pid=28924): Launched 10:27:10.922325 bus /sierra_2: Setting Powered False 10:27:11.983106 run create_hlr_db(pid=28924): Terminated: ok {rc=0} 10:27:12.422327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28926): Launched 10:27:12.742879 run osmo-hlr_10.42.42.2(pid=28927): Launched 10:27:12.865818 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:13.420559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28929): Launched 10:27:13.740469 run osmo-stp_10.42.42.5(pid=28930): Launched 10:27:13.874250 tst emergency_mo_mt_call.py: using MSISDN 7685 10:27:14.042911 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:14.618629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28932): Launched 10:27:14.939726 run osmo-msc_10.42.42.6(pid=28933): Launched 10:27:15.119506 run osmo-stp_10.42.42.5(pid=28930): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28930)] 10:27:15.255337 run osmo-stp_10.42.42.5(pid=28930): stdout: | (launched: 2022-12-10_10:27:13.682728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:15.391614 run osmo-stp_10.42.42.5(pid=28930): stderr: | 20221210102713875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102713875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102713875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102713876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102713878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102713878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102713878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:15.527324 run osmo-stp_10.42.42.5(pid=28930): stdout: | (launched: 2022-12-10_10:27:13.682728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:15.655079 run osmo-stp_10.42.42.5(pid=28930): stderr: | 20221210102713875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102713875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102713875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102713876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102713878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102713878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102713878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:15.807964 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28930): Process ended prematurely: osmo-stp_10.42.42.5(pid=28930) [trial-2373↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28930)] [trial-2373↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 10:27:15.817082 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 10:27:15.851001 run osmo-hlr_10.42.42.2(pid=28927): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28927)] 10:27:15.904581 run osmo-hlr_10.42.42.2(pid=28927): stdout: | (launched: 2022-12-10_10:27:12.685562) 10:27:15.976203 run osmo-hlr_10.42.42.2(pid=28927): stderr: | 20221210102712879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102712879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102712879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102712879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102712879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102712880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102712892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102712901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102712901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102712901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:16.050231 run osmo-msc_10.42.42.6(pid=28933): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28933)] 10:27:16.100197 run osmo-msc_10.42.42.6(pid=28933): stdout: | (launched: 2022-12-10_10:27:14.881973) 10:27:16.153151 run osmo-msc_10.42.42.6(pid=28933): stderr: | 20221210102715203 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102715203 DLGLOBAL DEBUG validating counter group 0x7f2f443a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102715203 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102715203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102715203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102715204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102715206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102715206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102715206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102715206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:16.205308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28926): Terminating (SIGTERM) 10:27:16.247541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28929): Terminating (SIGTERM) 10:27:16.291310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28932): Terminating (SIGTERM) 10:27:16.335456 --- ParallelTerminationStrategy: PID 28926 died... 10:27:16.356522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28926): Terminated: ok {rc=0} 10:27:16.405233 --- ParallelTerminationStrategy: PID 28929 died... 10:27:16.424744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28929): Terminated: ok {rc=0} 10:27:16.471636 --- ParallelTerminationStrategy: PID 28932 died... 10:27:16.490997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28932): Terminated: ok {rc=0} 10:27:16.579094 bus /sierra_3: Setting Powered False 10:27:17.675808 bus /sierra_3: Setting Powered False 10:27:18.789672 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 10:27:19.877271 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:19.889116 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 10:27:19.940890 tst emergency_preemptive_call.py: using LAC 27755 10:27:20.059514 tst emergency_preemptive_call.py: using RAC 215 10:27:20.180435 tst emergency_preemptive_call.py: using CellId 27755 10:27:20.298485 tst emergency_preemptive_call.py: using BVCI 27756 10:27:20.407557 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:20.418447 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:20.429173 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:20.439989 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:20.450810 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 10:27:20.461478 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:20.578032 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:20.693909 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:20.812380 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:20.932246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:21.429613 run create_hlr_db(pid=28935): Launched 10:27:21.553675 bus /sierra_2: Setting Powered False 10:27:22.617938 run create_hlr_db(pid=28935): Terminated: ok {rc=0} 10:27:23.048266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28937): Launched 10:27:23.348048 run osmo-hlr_10.42.42.2(pid=28938): Launched 10:27:23.463670 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:23.980817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28940): Launched 10:27:24.281103 run osmo-stp_10.42.42.5(pid=28941): Launched 10:27:24.406626 tst emergency_preemptive_call.py: using MSISDN 7686 10:27:24.559540 run osmo-msc_10.42.42.6: Starting osmo-msc 10:27:25.097419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28943): Launched 10:27:25.397593 run osmo-msc_10.42.42.6(pid=28944): Launched 10:27:25.566513 run osmo-stp_10.42.42.5(pid=28941): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28941)] 10:27:25.693603 run osmo-stp_10.42.42.5(pid=28941): stdout: | (launched: 2022-12-10_10:27:24.226245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:25.820319 run osmo-stp_10.42.42.5(pid=28941): stderr: | 20221210102724398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102724398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102724398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102724399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102724400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102724400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102724400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:25.945383 run osmo-stp_10.42.42.5(pid=28941): stdout: | (launched: 2022-12-10_10:27:24.226245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:26.064423 run osmo-stp_10.42.42.5(pid=28941): stderr: | 20221210102724398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102724398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102724398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102724399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102724400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102724400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102724400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:26.207213 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28941): Process ended prematurely: osmo-stp_10.42.42.5(pid=28941) [trial-2373↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28941)] [trial-2373↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 10:27:26.215563 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 10:27:26.241695 run osmo-hlr_10.42.42.2(pid=28938): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28938)] 10:27:26.289611 run osmo-hlr_10.42.42.2(pid=28938): stdout: | (launched: 2022-12-10_10:27:23.293785) 10:27:26.338928 run osmo-hlr_10.42.42.2(pid=28938): stderr: | 20221210102723466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102723466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102723466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102723466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102723466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102723466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102723478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102723489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102723489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102723489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:26.408099 run osmo-msc_10.42.42.6(pid=28944): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28944)] 10:27:26.455779 run osmo-msc_10.42.42.6(pid=28944): stdout: | (launched: 2022-12-10_10:27:25.342196) 10:27:26.505088 run osmo-msc_10.42.42.6(pid=28944): stderr: | 20221210102725614 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210102725614 DLGLOBAL DEBUG validating counter group 0x7fab6353bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210102725614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210102725614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210102725615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210102725615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210102725618 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210102725618 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210102725618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210102725618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:27:26.554512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28937): Terminating (SIGTERM) 10:27:26.594250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28940): Terminating (SIGTERM) 10:27:26.633894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28943): Terminating (SIGTERM) 10:27:26.674118 --- ParallelTerminationStrategy: PID 28937 died... 10:27:26.693381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28937): Terminated: ok {rc=0} 10:27:26.737744 --- ParallelTerminationStrategy: PID 28940 died... 10:27:26.756446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28940): Terminated: ok {rc=0} 10:27:26.800447 --- ParallelTerminationStrategy: PID 28943 died... 10:27:26.819240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28943): Terminated: ok {rc=0} 10:27:26.903241 bus /sierra_9: Setting Powered False 10:27:28.001723 bus /sierra_9: Setting Powered False 10:27:29.121799 bus /sierra_8: Setting Powered False 10:27:30.223272 bus /sierra_8: Setting Powered False 10:27:31.342369 bus /sierra_3: Setting Powered False 10:27:32.439792 bus /sierra_3: Setting Powered False 10:27:33.555965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx --------------------------------------------------------------------- 10:27:34.833126 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:27:34.837521 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 10:27:34.869746 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 10:27:34.907902 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 10:27:34.994611 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 10:27:35.026627 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 10:27:35.065083 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 10:27:35.655280 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 10:27:35.705159 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:35.715701 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:27:35.764283 tst cs_paging_gprs_active.py: using LAC 27756 10:27:35.888228 tst cs_paging_gprs_active.py: using RAC 216 10:27:36.009365 tst cs_paging_gprs_active.py: using CellId 27756 10:27:36.127011 tst cs_paging_gprs_active.py: using BVCI 27757 10:27:36.239394 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.250093 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.260428 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.270860 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.281126 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.291345 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.301815 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.311985 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:36.322460 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:36.439841 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:36.554930 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:27:36.762806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:37.069060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28955): Launched 10:27:37.335404 run iperf3-srv_10.42.42.10(pid=28956): Launched 10:27:37.450464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:27:37.656908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:37.962735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28957): Launched 10:27:38.229112 run iperf3-srv_10.42.42.10(pid=28958): Launched 10:27:38.344025 tst cs_paging_gprs_active.py:38: start network... 10:27:38.548668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:39.022385 run create_hlr_db(pid=28959): Launched 10:27:39.147406 bus /sierra_2: Setting Powered False 10:27:40.208328 run create_hlr_db(pid=28959): Terminated: ok {rc=0} 10:27:40.656212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28961): Launched 10:27:40.982867 run osmo-hlr_10.42.42.2(pid=28962): Launched 10:27:41.109137 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:41.673390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28964): Launched 10:27:42.000216 run osmo-stp_10.42.42.5(pid=28965): Launched 10:27:42.125162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:42.689169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28967): Launched 10:27:42.814732 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:43.090181 run patchelf(pid=28968): Launched 10:27:43.272753 run osmo-stp_10.42.42.5(pid=28965): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28965)] 10:27:43.411521 run osmo-stp_10.42.42.5(pid=28965): stdout: | (launched: 2022-12-10_10:27:41.941291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:43.551972 run osmo-stp_10.42.42.5(pid=28965): stderr: | 20221210102742133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102742133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102742133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102742134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102742134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102742134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102742134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:43.692491 run osmo-stp_10.42.42.5(pid=28965): stdout: | (launched: 2022-12-10_10:27:41.941291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:43.827372 run osmo-stp_10.42.42.5(pid=28965): stderr: | 20221210102742133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102742133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102742133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102742134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102742134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102742134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102742134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:43.986850 run patchelf(pid=28968): Terminating (SIGINT) 10:27:44.170992 run patchelf(pid=28968): Terminated: ok {rc=0} 10:27:44.304205 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28965): Process ended prematurely: osmo-stp_10.42.42.5(pid=28965) [trial-2373↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28965)] [trial-2373↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 10:27:44.314459 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:27:44.344097 run osmo-hlr_10.42.42.2(pid=28962): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28962)] 10:27:44.394881 run osmo-hlr_10.42.42.2(pid=28962): stdout: | (launched: 2022-12-10_10:27:40.923882) 10:27:44.447436 run osmo-hlr_10.42.42.2(pid=28962): stderr: | 20221210102741123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102741123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102741123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102741123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102741123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102741123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102741136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102741145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102741145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102741145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:44.500307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28955): Terminating (SIGTERM) 10:27:44.542854 run iperf3-srv_10.42.42.10(pid=28956): Terminating (SIGTERM) 10:27:44.585330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28957): Terminating (SIGTERM) 10:27:44.627886 run iperf3-srv_10.42.42.10(pid=28958): Terminating (SIGTERM) 10:27:44.670315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28961): Terminating (SIGTERM) 10:27:44.712864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28964): Terminating (SIGTERM) 10:27:44.755389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28967): Terminating (SIGTERM) 10:27:44.798173 --- ParallelTerminationStrategy: PID 28955 died... 10:27:44.818288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28955): Terminated: ok {rc=0} 10:27:44.865304 --- ParallelTerminationStrategy: PID 28956 died... 10:27:44.884729 run iperf3-srv_10.42.42.10(pid=28956): Terminated {rc=256} 10:27:44.931686 --- ParallelTerminationStrategy: PID 28957 died... 10:27:44.951361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28957): Terminated: ok {rc=0} 10:27:44.998381 --- ParallelTerminationStrategy: PID 28958 died... 10:27:45.018131 run iperf3-srv_10.42.42.10(pid=28958): Terminated {rc=256} 10:27:45.065239 --- ParallelTerminationStrategy: PID 28961 died... 10:27:45.084738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28961): Terminated: ok {rc=0} 10:27:45.131898 --- ParallelTerminationStrategy: PID 28964 died... 10:27:45.151778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28964): Terminated: ok {rc=0} 10:27:45.198835 --- ParallelTerminationStrategy: PID 28967 died... 10:27:45.218786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28967): Terminated: ok {rc=0} 10:27:45.308208 bus /gobi_0: Setting Powered False 10:27:46.409428 bus /gobi_0: Setting Powered False 10:27:47.527521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx iperf3.py ---------------------------------------------- 10:27:48.674633 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:48.686033 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:27:48.737228 tst iperf3.py: using LAC 27757 10:27:48.856933 tst iperf3.py: using RAC 217 10:27:48.976637 tst iperf3.py: using CellId 27757 10:27:49.098512 tst iperf3.py: using BVCI 27758 10:27:49.211380 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.222196 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.232735 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.243254 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.253670 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.264031 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.274611 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.285072 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:49.295630 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:49.414009 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:27:49.635744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:49.963249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28969): Launched 10:27:50.248471 run iperf3-srv_10.42.42.10(pid=28970): Launched 10:27:50.371741 tst iperf3.py:8: start network... 10:27:50.592769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:27:51.098546 run create_hlr_db(pid=28971): Launched 10:27:51.224197 bus /gobi_6: Setting Powered False 10:27:52.289318 run create_hlr_db(pid=28971): Terminated: ok {rc=0} 10:27:52.744770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28973): Launched 10:27:53.071344 run osmo-hlr_10.42.42.2(pid=28974): Launched 10:27:53.197021 run osmo-stp_10.42.42.5: Starting osmo-stp 10:27:53.762065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28976): Launched 10:27:54.087902 run osmo-stp_10.42.42.5(pid=28977): Launched 10:27:54.212070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:27:54.773103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28979): Launched 10:27:54.898679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:27:55.174266 run patchelf(pid=28980): Launched 10:27:55.356404 run osmo-stp_10.42.42.5(pid=28977): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28977)] 10:27:55.495032 run osmo-stp_10.42.42.5(pid=28977): stdout: | (launched: 2022-12-10_10:27:54.028914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:55.635553 run osmo-stp_10.42.42.5(pid=28977): stderr: | 20221210102754220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102754220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102754220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102754221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102754223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102754223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102754223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:55.776025 run osmo-stp_10.42.42.5(pid=28977): stdout: | (launched: 2022-12-10_10:27:54.028914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:27:55.910041 run osmo-stp_10.42.42.5(pid=28977): stderr: | 20221210102754220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102754220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102754220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102754221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102754223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102754223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102754223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:27:56.068398 run patchelf(pid=28980): Terminating (SIGINT) 10:27:56.251874 run patchelf(pid=28980): Terminated: ok {rc=0} 10:27:56.384118 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28977): Process ended prematurely: osmo-stp_10.42.42.5(pid=28977) [trial-2373↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28977)] [trial-2373↪gprs:trx-umtrx↪iperf3.py:8] 10:27:56.394195 tst iperf3.py:8: Test FAILED (7.8 sec) 10:27:56.423308 run osmo-hlr_10.42.42.2(pid=28974): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28974)] 10:27:56.473934 run osmo-hlr_10.42.42.2(pid=28974): stdout: | (launched: 2022-12-10_10:27:53.012379) 10:27:56.526134 run osmo-hlr_10.42.42.2(pid=28974): stderr: | 20221210102753211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102753212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102753212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102753212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102753212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102753212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102753225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102753233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102753233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102753233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:27:56.578830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28969): Terminating (SIGTERM) 10:27:56.621159 run iperf3-srv_10.42.42.10(pid=28970): Terminating (SIGTERM) 10:27:56.663617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28973): Terminating (SIGTERM) 10:27:56.706064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28976): Terminating (SIGTERM) 10:27:56.748543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28979): Terminating (SIGTERM) 10:27:56.791416 --- ParallelTerminationStrategy: PID 28969 died... 10:27:56.811664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28969): Terminated: ok {rc=0} 10:27:56.859254 --- ParallelTerminationStrategy: PID 28970 died... 10:27:56.879101 run iperf3-srv_10.42.42.10(pid=28970): Terminated {rc=256} 10:27:56.926141 --- ParallelTerminationStrategy: PID 28973 died... 10:27:56.946054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28973): Terminated: ok {rc=0} 10:27:56.993256 --- ParallelTerminationStrategy: PID 28976 died... 10:27:57.012942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28976): Terminated: ok {rc=0} 10:27:57.060217 --- ParallelTerminationStrategy: PID 28979 died... 10:27:57.080063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28979): Terminated: ok {rc=0} 10:27:57.168172 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 10:27:58.317907 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.329258 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:27:58.378518 tst iperf3m4.py: using LAC 27758 10:27:58.500797 tst iperf3m4.py: using RAC 218 10:27:58.623475 tst iperf3m4.py: using CellId 27758 10:27:58.745449 tst iperf3m4.py: using BVCI 27759 10:27:58.866006 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.877496 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.888629 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.899815 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.911209 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.922540 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.934142 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.945441 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:27:58.956631 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:59.075112 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:59.203418 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:59.324509 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:27:59.440745 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:27:59.647687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:27:59.955853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28981): Launched 10:28:00.222773 run iperf3-srv_10.42.42.10(pid=28982): Launched 10:28:00.338310 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:28:00.543381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:00.861909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28983): Launched 10:28:01.173155 run iperf3-srv_10.42.42.10(pid=28984): Launched 10:28:01.310395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:28:01.539591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:01.881082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28985): Launched 10:28:02.193847 run iperf3-srv_10.42.42.10(pid=28986): Launched 10:28:02.327448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:28:02.548317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:02.875807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28987): Launched 10:28:03.160397 run iperf3-srv_10.42.42.10(pid=28988): Launched 10:28:03.283781 tst iperf3m4.py:8: start network... 10:28:03.503729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:04.010466 run create_hlr_db(pid=28989): Launched 10:28:04.135515 bus /gobi_6: Setting Powered False 10:28:05.200365 run create_hlr_db(pid=28989): Terminated: ok {rc=0} 10:28:05.655778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28991): Launched 10:28:05.981903 run osmo-hlr_10.42.42.2(pid=28992): Launched 10:28:06.107771 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:06.673474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28994): Launched 10:28:07.001029 run osmo-stp_10.42.42.5(pid=28995): Launched 10:28:07.126905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:07.691767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28997): Launched 10:28:07.817167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:08.092761 run patchelf(pid=28998): Launched 10:28:08.275288 run osmo-stp_10.42.42.5(pid=28995): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28995)] 10:28:08.414237 run osmo-stp_10.42.42.5(pid=28995): stdout: | (launched: 2022-12-10_10:28:06.941912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:08.555060 run osmo-stp_10.42.42.5(pid=28995): stderr: | 20221210102807133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102807133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102807133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102807134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102807134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102807134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102807134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:08.695576 run osmo-stp_10.42.42.5(pid=28995): stdout: | (launched: 2022-12-10_10:28:06.941912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:08.829463 run osmo-stp_10.42.42.5(pid=28995): stderr: | 20221210102807133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102807133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102807133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102807134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102807134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102807134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102807134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:08.988214 run patchelf(pid=28998): Terminating (SIGINT) 10:28:09.171208 run patchelf(pid=28998): Terminated: ok {rc=0} 10:28:09.304375 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28995): Process ended prematurely: osmo-stp_10.42.42.5(pid=28995) [trial-2373↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28995)] [trial-2373↪gprs:trx-umtrx↪iperf3m4.py:8] 10:28:09.314576 tst iperf3m4.py:8: Test FAILED (11.0 sec) 10:28:09.344065 run osmo-hlr_10.42.42.2(pid=28992): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28992)] 10:28:09.394985 run osmo-hlr_10.42.42.2(pid=28992): stdout: | (launched: 2022-12-10_10:28:05.923087) 10:28:09.447347 run osmo-hlr_10.42.42.2(pid=28992): stderr: | 20221210102806120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102806120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102806120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102806120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102806120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102806120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102806135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102806146 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102806146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102806146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:09.500238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28981): Terminating (SIGTERM) 10:28:09.543001 run iperf3-srv_10.42.42.10(pid=28982): Terminating (SIGTERM) 10:28:09.585550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28983): Terminating (SIGTERM) 10:28:09.628207 run iperf3-srv_10.42.42.10(pid=28984): Terminating (SIGTERM) 10:28:09.670759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28985): Terminating (SIGTERM) 10:28:09.713389 run iperf3-srv_10.42.42.10(pid=28986): Terminating (SIGTERM) 10:28:09.755728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28987): Terminating (SIGTERM) 10:28:09.798198 run iperf3-srv_10.42.42.10(pid=28988): Terminating (SIGTERM) 10:28:09.840533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28991): Terminating (SIGTERM) 10:28:09.883448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28994): Terminating (SIGTERM) 10:28:09.926290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28997): Terminating (SIGTERM) 10:28:09.969147 --- ParallelTerminationStrategy: PID 28981 died... 10:28:09.989264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28981): Terminated: ok {rc=0} 10:28:10.036069 --- ParallelTerminationStrategy: PID 28982 died... 10:28:10.055682 run iperf3-srv_10.42.42.10(pid=28982): Terminated {rc=256} 10:28:10.102375 --- ParallelTerminationStrategy: PID 28983 died... 10:28:10.121984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28983): Terminated: ok {rc=0} 10:28:10.168808 --- ParallelTerminationStrategy: PID 28984 died... 10:28:10.188728 run iperf3-srv_10.42.42.10(pid=28984): Terminated {rc=256} 10:28:10.235298 --- ParallelTerminationStrategy: PID 28985 died... 10:28:10.254740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28985): Terminated: ok {rc=0} 10:28:10.301173 --- ParallelTerminationStrategy: PID 28986 died... 10:28:10.320586 run iperf3-srv_10.42.42.10(pid=28986): Terminated {rc=256} 10:28:10.367138 --- ParallelTerminationStrategy: PID 28987 died... 10:28:10.386623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28987): Terminated: ok {rc=0} 10:28:10.433143 --- ParallelTerminationStrategy: PID 28988 died... 10:28:10.452644 run iperf3-srv_10.42.42.10(pid=28988): Terminated {rc=256} 10:28:10.499052 --- ParallelTerminationStrategy: PID 28991 died... 10:28:10.518610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28991): Terminated: ok {rc=0} 10:28:10.565174 --- ParallelTerminationStrategy: PID 28994 died... 10:28:10.584903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28994): Terminated: ok {rc=0} 10:28:10.631409 --- ParallelTerminationStrategy: PID 28997 died... 10:28:10.650943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28997): Terminated: ok {rc=0} 10:28:10.738434 bus /gobi_4: Setting Powered False 10:28:11.837499 bus /gobi_4: Setting Powered False 10:28:12.953305 bus /gobi_1: Setting Powered False 10:28:14.052538 bus /gobi_1: Setting Powered False 10:28:15.168147 bus /gobi_0: Setting Powered False 10:28:16.269955 bus /gobi_0: Setting Powered False 10:28:17.389872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx ping.py ---------------------------------------------- 10:28:18.493502 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:18.504621 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:28:18.553499 tst ping.py: using LAC 27759 10:28:18.672034 tst ping.py: using RAC 219 10:28:18.790643 tst ping.py: using CellId 27759 10:28:18.908216 tst ping.py: using BVCI 27760 10:28:19.018453 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:19.028998 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:19.039376 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:19.049795 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:19.060015 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:19.070435 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:19.081136 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:19.091457 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:28:19.205049 tst ping.py:19: start network... 10:28:19.406723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:19.869376 run create_hlr_db(pid=28999): Launched 10:28:19.993450 bus /gobi_6: Setting Powered False 10:28:21.053208 run create_hlr_db(pid=28999): Terminated: ok {rc=0} 10:28:21.491304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29001): Launched 10:28:21.811317 run osmo-hlr_10.42.42.2(pid=29002): Launched 10:28:21.934659 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:22.487486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29004): Launched 10:28:22.807625 run osmo-stp_10.42.42.5(pid=29005): Launched 10:28:22.930353 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:23.484010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29007): Launched 10:28:23.607268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:23.877771 run patchelf(pid=29008): Launched 10:28:24.058131 run osmo-stp_10.42.42.5(pid=29005): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29005)] 10:28:24.194435 run osmo-stp_10.42.42.5(pid=29005): stdout: | (launched: 2022-12-10_10:28:22.749734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:24.332935 run osmo-stp_10.42.42.5(pid=29005): stderr: | 20221210102822942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102822943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102822943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102822943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102822944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102822944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102822944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:24.471213 run osmo-stp_10.42.42.5(pid=29005): stdout: | (launched: 2022-12-10_10:28:22.749734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:24.603231 run osmo-stp_10.42.42.5(pid=29005): stderr: | 20221210102822942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102822943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102822943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102822943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102822944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102822944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102822944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:24.759970 run patchelf(pid=29008): Terminating (SIGINT) 10:28:24.941128 run patchelf(pid=29008): Terminated: ok {rc=0} 10:28:25.072094 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29005): Process ended prematurely: osmo-stp_10.42.42.5(pid=29005) [trial-2373↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29005)] [trial-2373↪gprs:trx-umtrx↪ping.py:22] 10:28:25.081676 tst ping.py:22: Test FAILED (6.6 sec) 10:28:25.110597 run osmo-hlr_10.42.42.2(pid=29002): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29002)] 10:28:25.161135 run osmo-hlr_10.42.42.2(pid=29002): stdout: | (launched: 2022-12-10_10:28:21.753804) 10:28:25.213451 run osmo-hlr_10.42.42.2(pid=29002): stderr: | 20221210102821952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102821952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102821952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102821952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102821952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102821952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102821964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102821972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102821973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102821973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:25.266161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29001): Terminating (SIGTERM) 10:28:25.308366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29004): Terminating (SIGTERM) 10:28:25.350605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29007): Terminating (SIGTERM) 10:28:25.392931 --- ParallelTerminationStrategy: PID 29001 died... 10:28:25.413037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29001): Terminated: ok {rc=0} 10:28:25.459909 --- ParallelTerminationStrategy: PID 29004 died... 10:28:25.479608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29004): Terminated: ok {rc=0} 10:28:25.526154 --- ParallelTerminationStrategy: PID 29007 died... 10:28:25.545884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29007): Terminated: ok {rc=0} 10:28:25.634776 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 10:28:26.721996 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:26.733747 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 10:28:26.785431 tst ping_idle_ping.py: using LAC 27760 10:28:26.912310 tst ping_idle_ping.py: using RAC 220 10:28:27.039447 tst ping_idle_ping.py: using CellId 27760 10:28:27.161748 tst ping_idle_ping.py: using BVCI 27761 10:28:27.272221 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:27.283115 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:27.293905 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:27.304662 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:27.315534 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:27.326158 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:27.336827 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 10:28:27.347617 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 10:28:27.466160 tst ping_idle_ping.py:24: start network... 10:28:27.683172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:28.181957 run create_hlr_db(pid=29009): Launched 10:28:28.304912 bus /gobi_6: Setting Powered False 10:28:29.368688 run create_hlr_db(pid=29009): Terminated: ok {rc=0} 10:28:29.799493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Launched 10:28:30.101459 run osmo-hlr_10.42.42.2(pid=29012): Launched 10:28:30.217235 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:30.736139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Launched 10:28:31.081215 run osmo-stp_10.42.42.5(pid=29015): Launched 10:28:31.344734 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:32.048124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29017): Launched 10:28:32.179885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:32.455435 run patchelf(pid=29018): Launched 10:28:32.635735 run osmo-stp_10.42.42.5(pid=29015): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] 10:28:32.772621 run osmo-stp_10.42.42.5(pid=29015): stdout: | (launched: 2022-12-10_10:28:31.016850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:32.910985 run osmo-stp_10.42.42.5(pid=29015): stderr: | 20221210102831247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102831247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102831247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102831248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102831248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102831248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102831248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:33.049677 run osmo-stp_10.42.42.5(pid=29015): stdout: | (launched: 2022-12-10_10:28:31.016850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:33.181865 run osmo-stp_10.42.42.5(pid=29015): stderr: | 20221210102831247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102831247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102831247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102831248 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102831248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102831248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102831248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:33.339025 run patchelf(pid=29018): Terminating (SIGINT) 10:28:33.519180 run patchelf(pid=29018): Terminated: ok {rc=0} 10:28:33.649169 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29015): Process ended prematurely: osmo-stp_10.42.42.5(pid=29015) [trial-2373↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] [trial-2373↪gprs:trx-umtrx↪ping_idle_ping.py:27] 10:28:33.658693 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 10:28:33.687703 run osmo-hlr_10.42.42.2(pid=29012): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29012)] 10:28:33.738566 run osmo-hlr_10.42.42.2(pid=29012): stdout: | (launched: 2022-12-10_10:28:30.046068) 10:28:33.791327 run osmo-hlr_10.42.42.2(pid=29012): stderr: | 20221210102830224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102830224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102830224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102830224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102830224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102830224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102830242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102830251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102830251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102830251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:33.844493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Terminating (SIGTERM) 10:28:33.887325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Terminating (SIGTERM) 10:28:33.930278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29017): Terminating (SIGTERM) 10:28:33.973449 --- ParallelTerminationStrategy: PID 29011 died... 10:28:33.993773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29011): Terminated: ok {rc=0} 10:28:34.041650 --- ParallelTerminationStrategy: PID 29014 died... 10:28:34.061605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29014): Terminated: ok {rc=0} 10:28:34.109057 --- ParallelTerminationStrategy: PID 29017 died... 10:28:34.129110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29017): Terminated: ok {rc=0} 10:28:34.218517 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 10:28:35.521354 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:28:35.527492 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:28:35.562543 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:28:35.602676 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:28:35.694835 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:28:35.727589 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:28:35.766249 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:28:36.362158 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:28:36.416088 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:36.427711 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:28:36.479627 tst cs_paging_gprs_active.py: using LAC 27761 10:28:36.611614 tst cs_paging_gprs_active.py: using RAC 221 10:28:36.739575 tst cs_paging_gprs_active.py: using CellId 27761 10:28:36.867334 tst cs_paging_gprs_active.py: using BVCI 27762 10:28:36.986542 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:36.998006 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:37.009129 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:37.020587 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:37.031928 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:37.043212 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:37.054716 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:37.065746 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:37.077570 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:37.195964 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:37.316846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:28:37.539031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:37.867557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29022): Launched 10:28:38.153016 run iperf3-srv_10.42.42.10(pid=29023): Launched 10:28:38.276726 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:28:38.498704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:38.827374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Launched 10:28:39.112804 run iperf3-srv_10.42.42.10(pid=29025): Launched 10:28:39.235737 tst cs_paging_gprs_active.py:38: start network... 10:28:39.458618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:39.966905 run create_hlr_db(pid=29026): Launched 10:28:40.092162 bus /gobi_6: Setting Powered False 10:28:41.156721 run create_hlr_db(pid=29026): Terminated: ok {rc=0} 10:28:41.595844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Launched 10:28:41.903514 run osmo-hlr_10.42.42.2(pid=29029): Launched 10:28:42.021141 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:42.550341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Launched 10:28:42.855412 run osmo-stp_10.42.42.5(pid=29032): Launched 10:28:42.972048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:43.498726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Launched 10:28:43.615897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:43.873090 run patchelf(pid=29035): Launched 10:28:44.043850 run osmo-stp_10.42.42.5(pid=29032): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] 10:28:44.173713 run osmo-stp_10.42.42.5(pid=29032): stdout: | (launched: 2022-12-10_10:28:42.799828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:44.304905 run osmo-stp_10.42.42.5(pid=29032): stderr: | 20221210102842970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102842970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102842970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102842971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102842971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102842971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102842971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:44.435856 run osmo-stp_10.42.42.5(pid=29032): stdout: | (launched: 2022-12-10_10:28:42.799828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:44.561297 run osmo-stp_10.42.42.5(pid=29032): stderr: | 20221210102842970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102842970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102842970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102842971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102842971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102842971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102842971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:44.709900 run patchelf(pid=29035): Terminating (SIGINT) 10:28:44.882233 run patchelf(pid=29035): Terminated: ok {rc=0} 10:28:45.006286 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29032): Process ended prematurely: osmo-stp_10.42.42.5(pid=29032) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:28:45.015548 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:28:45.042737 run osmo-hlr_10.42.42.2(pid=29029): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29029)] 10:28:45.089976 run osmo-hlr_10.42.42.2(pid=29029): stdout: | (launched: 2022-12-10_10:28:41.847697) 10:28:45.139052 run osmo-hlr_10.42.42.2(pid=29029): stderr: | 20221210102842022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102842023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102842023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102842023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102842023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102842023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102842035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102842043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102842043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102842043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:45.188355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29022): Terminating (SIGTERM) 10:28:45.227975 run iperf3-srv_10.42.42.10(pid=29023): Terminating (SIGTERM) 10:28:45.267503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Terminating (SIGTERM) 10:28:45.307031 run iperf3-srv_10.42.42.10(pid=29025): Terminating (SIGTERM) 10:28:45.346404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Terminating (SIGTERM) 10:28:45.386088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Terminating (SIGTERM) 10:28:45.425675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Terminating (SIGTERM) 10:28:45.465321 --- ParallelTerminationStrategy: PID 29022 died... 10:28:45.484378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29022): Terminated: ok {rc=0} 10:28:45.528273 --- ParallelTerminationStrategy: PID 29023 died... 10:28:45.546942 run iperf3-srv_10.42.42.10(pid=29023): Terminated {rc=256} 10:28:45.590422 --- ParallelTerminationStrategy: PID 29024 died... 10:28:45.608918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Terminated: ok {rc=0} 10:28:45.652576 --- ParallelTerminationStrategy: PID 29025 died... 10:28:45.671221 run iperf3-srv_10.42.42.10(pid=29025): Terminated {rc=256} 10:28:45.714597 --- ParallelTerminationStrategy: PID 29028 died... 10:28:45.733265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Terminated: ok {rc=0} 10:28:45.776743 --- ParallelTerminationStrategy: PID 29031 died... 10:28:45.795386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Terminated: ok {rc=0} 10:28:45.843676 --- ParallelTerminationStrategy: PID 29034 died... 10:28:45.863380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Terminated: ok {rc=0} 10:28:45.970917 bus /gobi_0: Setting Powered False 10:28:47.077201 bus /gobi_0: Setting Powered False 10:28:48.202698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:28:49.354230 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:49.366398 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:28:49.421397 tst iperf3.py: using LAC 27762 10:28:49.552315 tst iperf3.py: using RAC 222 10:28:49.680886 tst iperf3.py: using CellId 27762 10:28:49.811443 tst iperf3.py: using BVCI 27763 10:28:49.931316 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:49.942995 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:49.954206 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:49.966172 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:49.978120 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:49.990667 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:50.002536 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:50.014426 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:50.026709 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:50.146389 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:28:50.353181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:28:50.660065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Launched 10:28:50.926913 run iperf3-srv_10.42.42.10(pid=29037): Launched 10:28:51.041779 tst iperf3.py:8: start network... 10:28:51.246229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:28:51.718384 run create_hlr_db(pid=29038): Launched 10:28:51.843009 bus /gobi_6: Setting Powered False 10:28:52.903867 run create_hlr_db(pid=29038): Terminated: ok {rc=0} 10:28:53.348762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29041): Launched 10:28:53.676192 run osmo-hlr_10.42.42.2(pid=29042): Launched 10:28:53.801178 run osmo-stp_10.42.42.5: Starting osmo-stp 10:28:54.372106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29044): Launched 10:28:54.698039 run osmo-stp_10.42.42.5(pid=29045): Launched 10:28:54.822604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:28:55.383482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29047): Launched 10:28:55.508614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:28:55.783090 run patchelf(pid=29048): Launched 10:28:55.964453 run osmo-stp_10.42.42.5(pid=29045): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29045)] 10:28:56.102691 run osmo-stp_10.42.42.5(pid=29045): stdout: | (launched: 2022-12-10_10:28:54.638772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:56.242462 run osmo-stp_10.42.42.5(pid=29045): stderr: | 20221210102854834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102854834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102854834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102854835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102854835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102854835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102854835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:56.383341 run osmo-stp_10.42.42.5(pid=29045): stdout: | (launched: 2022-12-10_10:28:54.638772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:28:56.516839 run osmo-stp_10.42.42.5(pid=29045): stderr: | 20221210102854834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102854834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102854834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102854835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102854835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102854835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102854835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:28:56.674814 run patchelf(pid=29048): Terminating (SIGINT) 10:28:56.857168 run patchelf(pid=29048): Terminated: ok {rc=0} 10:28:56.988908 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29045): Process ended prematurely: osmo-stp_10.42.42.5(pid=29045) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29045)] [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 10:28:56.999012 tst iperf3.py:8: Test FAILED (7.7 sec) 10:28:57.028285 run osmo-hlr_10.42.42.2(pid=29042): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29042)] 10:28:57.078689 run osmo-hlr_10.42.42.2(pid=29042): stdout: | (launched: 2022-12-10_10:28:53.617363) 10:28:57.130887 run osmo-hlr_10.42.42.2(pid=29042): stderr: | 20221210102853817 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102853817 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102853817 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102853817 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102853817 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102853817 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102853829 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102853839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102853839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102853839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:28:57.183512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Terminating (SIGTERM) 10:28:57.225819 run iperf3-srv_10.42.42.10(pid=29037): Terminating (SIGTERM) 10:28:57.268365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29041): Terminating (SIGTERM) 10:28:57.310960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29044): Terminating (SIGTERM) 10:28:57.353275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29047): Terminating (SIGTERM) 10:28:57.395807 --- ParallelTerminationStrategy: PID 29036 died... 10:28:57.415729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Terminated: ok {rc=0} 10:28:57.462944 --- ParallelTerminationStrategy: PID 29037 died... 10:28:57.482799 run iperf3-srv_10.42.42.10(pid=29037): Terminated {rc=256} 10:28:57.529553 --- ParallelTerminationStrategy: PID 29041 died... 10:28:57.549405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29041): Terminated: ok {rc=0} 10:28:57.596100 --- ParallelTerminationStrategy: PID 29044 died... 10:28:57.615786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29044): Terminated: ok {rc=0} 10:28:57.662652 --- ParallelTerminationStrategy: PID 29047 died... 10:28:57.682680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29047): Terminated: ok {rc=0} 10:28:57.771328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:28:58.921130 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:58.932584 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:28:58.983175 tst iperf3m4.py: using LAC 27763 10:28:59.104536 tst iperf3m4.py: using RAC 223 10:28:59.226331 tst iperf3m4.py: using CellId 27763 10:28:59.348099 tst iperf3m4.py: using BVCI 27764 10:28:59.460303 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.471325 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.482046 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.492731 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.503467 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.514109 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.524894 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.535486 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:28:59.546315 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:59.666130 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:59.787320 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:28:59.905504 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:00.023538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:29:00.229066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:00.535957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29049): Launched 10:29:00.803467 run iperf3-srv_10.42.42.10(pid=29050): Launched 10:29:00.939810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:29:01.149154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:01.477034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29051): Launched 10:29:01.762780 run iperf3-srv_10.42.42.10(pid=29052): Launched 10:29:01.899278 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:29:02.108469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:02.437948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29053): Launched 10:29:02.724535 run iperf3-srv_10.42.42.10(pid=29054): Launched 10:29:02.848884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:29:03.071096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:03.401291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29055): Launched 10:29:03.686398 run iperf3-srv_10.42.42.10(pid=29056): Launched 10:29:03.809685 tst iperf3m4.py:8: start network... 10:29:04.030670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:04.538507 run create_hlr_db(pid=29057): Launched 10:29:04.662949 bus /gobi_6: Setting Powered False 10:29:05.727063 run create_hlr_db(pid=29057): Terminated: ok {rc=0} 10:29:06.163038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29059): Launched 10:29:06.469717 run osmo-hlr_10.42.42.2(pid=29060): Launched 10:29:06.587330 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:07.122626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29062): Launched 10:29:07.431051 run osmo-stp_10.42.42.5(pid=29063): Launched 10:29:07.549794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:08.089689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29065): Launched 10:29:08.207684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:08.466086 run patchelf(pid=29066): Launched 10:29:08.637570 run osmo-stp_10.42.42.5(pid=29063): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29063)] 10:29:08.767490 run osmo-stp_10.42.42.5(pid=29063): stdout: | (launched: 2022-12-10_10:29:07.374999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:08.899719 run osmo-stp_10.42.42.5(pid=29063): stderr: | 20221210102907547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102907547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102907547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102907548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102907549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102907549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102907549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:09.031351 run osmo-stp_10.42.42.5(pid=29063): stdout: | (launched: 2022-12-10_10:29:07.374999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:09.156707 run osmo-stp_10.42.42.5(pid=29063): stderr: | 20221210102907547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102907547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102907547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102907548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102907549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102907549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102907549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:09.305518 run patchelf(pid=29066): Terminating (SIGINT) 10:29:09.477255 run patchelf(pid=29066): Terminated: ok {rc=0} 10:29:09.601351 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29063): Process ended prematurely: osmo-stp_10.42.42.5(pid=29063) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29063)] [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 10:29:09.610711 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:29:09.638449 run osmo-hlr_10.42.42.2(pid=29060): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29060)] 10:29:09.686606 run osmo-hlr_10.42.42.2(pid=29060): stdout: | (launched: 2022-12-10_10:29:06.414130) 10:29:09.736140 run osmo-hlr_10.42.42.2(pid=29060): stderr: | 20221210102906590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102906590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102906590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102906590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102906590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102906590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102906603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102906611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102906611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102906612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:09.786316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29049): Terminating (SIGTERM) 10:29:09.826447 run iperf3-srv_10.42.42.10(pid=29050): Terminating (SIGTERM) 10:29:09.866417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29051): Terminating (SIGTERM) 10:29:09.906205 run iperf3-srv_10.42.42.10(pid=29052): Terminating (SIGTERM) 10:29:09.945992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29053): Terminating (SIGTERM) 10:29:09.985955 run iperf3-srv_10.42.42.10(pid=29054): Terminating (SIGTERM) 10:29:10.025801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29055): Terminating (SIGTERM) 10:29:10.066297 run iperf3-srv_10.42.42.10(pid=29056): Terminating (SIGTERM) 10:29:10.105983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29059): Terminating (SIGTERM) 10:29:10.145784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29062): Terminating (SIGTERM) 10:29:10.185600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29065): Terminating (SIGTERM) 10:29:10.225669 --- ParallelTerminationStrategy: PID 29049 died... 10:29:10.244899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29049): Terminated: ok {rc=0} 10:29:10.289224 --- ParallelTerminationStrategy: PID 29050 died... 10:29:10.308041 run iperf3-srv_10.42.42.10(pid=29050): Terminated {rc=256} 10:29:10.351930 --- ParallelTerminationStrategy: PID 29051 died... 10:29:10.370692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29051): Terminated: ok {rc=0} 10:29:10.414975 --- ParallelTerminationStrategy: PID 29052 died... 10:29:10.433648 run iperf3-srv_10.42.42.10(pid=29052): Terminated {rc=256} 10:29:10.477599 --- ParallelTerminationStrategy: PID 29053 died... 10:29:10.496354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29053): Terminated: ok {rc=0} 10:29:10.540301 --- ParallelTerminationStrategy: PID 29054 died... 10:29:10.559105 run iperf3-srv_10.42.42.10(pid=29054): Terminated {rc=256} 10:29:10.602925 --- ParallelTerminationStrategy: PID 29055 died... 10:29:10.621769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29055): Terminated: ok {rc=0} 10:29:10.665843 --- ParallelTerminationStrategy: PID 29056 died... 10:29:10.684708 run iperf3-srv_10.42.42.10(pid=29056): Terminated {rc=256} 10:29:10.728509 --- ParallelTerminationStrategy: PID 29059 died... 10:29:10.747331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29059): Terminated: ok {rc=0} 10:29:10.791401 --- ParallelTerminationStrategy: PID 29062 died... 10:29:10.810363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29062): Terminated: ok {rc=0} 10:29:10.854548 --- ParallelTerminationStrategy: PID 29065 died... 10:29:10.873409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29065): Terminated: ok {rc=0} 10:29:10.959623 bus /gobi_4: Setting Powered False 10:29:12.059763 bus /gobi_4: Setting Powered False 10:29:13.177615 bus /gobi_1: Setting Powered False 10:29:14.275797 bus /gobi_1: Setting Powered False 10:29:15.392022 bus /gobi_0: Setting Powered False 10:29:16.498459 bus /gobi_0: Setting Powered False 10:29:17.623771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 10:29:18.727855 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:18.739969 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:29:18.794350 tst ping.py: using LAC 27764 10:29:18.922389 tst ping.py: using RAC 224 10:29:19.039723 tst ping.py: using CellId 27764 10:29:19.158906 tst ping.py: using BVCI 27765 10:29:19.269085 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:19.279972 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:19.290734 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:19.301454 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:19.312039 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:19.322724 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:19.333552 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:19.344218 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:19.459362 tst ping.py:19: start network... 10:29:19.659968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:20.124191 run create_hlr_db(pid=29067): Launched 10:29:20.247039 bus /gobi_6: Setting Powered False 10:29:21.307355 run create_hlr_db(pid=29067): Terminated: ok {rc=0} 10:29:21.726404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29069): Launched 10:29:22.026548 run osmo-hlr_10.42.42.2(pid=29070): Launched 10:29:22.140871 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:22.658400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29072): Launched 10:29:22.957231 run osmo-stp_10.42.42.5(pid=29073): Launched 10:29:23.071526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:23.587454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29075): Launched 10:29:23.702506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:23.955703 run patchelf(pid=29076): Launched 10:29:24.122508 run osmo-stp_10.42.42.5(pid=29073): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29073)] 10:29:24.249859 run osmo-stp_10.42.42.5(pid=29073): stdout: | (launched: 2022-12-10_10:29:22.902862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:24.378332 run osmo-stp_10.42.42.5(pid=29073): stderr: | 20221210102923070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102923070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102923071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102923071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102923073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102923073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102923073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:24.507188 run osmo-stp_10.42.42.5(pid=29073): stdout: | (launched: 2022-12-10_10:29:22.902862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:24.629786 run osmo-stp_10.42.42.5(pid=29073): stderr: | 20221210102923070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102923070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102923071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102923071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102923073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102923073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102923073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:24.775026 run patchelf(pid=29076): Terminating (SIGINT) 10:29:24.943004 run patchelf(pid=29076): Terminated: ok {rc=0} 10:29:25.064021 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29073): Process ended prematurely: osmo-stp_10.42.42.5(pid=29073) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29073)] [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 10:29:25.072892 tst ping.py:22: Test FAILED (6.3 sec) 10:29:25.099846 run osmo-hlr_10.42.42.2(pid=29070): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29070)] 10:29:25.147355 run osmo-hlr_10.42.42.2(pid=29070): stdout: | (launched: 2022-12-10_10:29:21.971729) 10:29:25.197151 run osmo-hlr_10.42.42.2(pid=29070): stderr: | 20221210102922147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102922147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102922147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102922147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102922148 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102922148 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102922161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102922171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102922171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102922171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:25.246757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29069): Terminating (SIGTERM) 10:29:25.286689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29072): Terminating (SIGTERM) 10:29:25.326894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29075): Terminating (SIGTERM) 10:29:25.367363 --- ParallelTerminationStrategy: PID 29069 died... 10:29:25.386307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29069): Terminated: ok {rc=0} 10:29:25.430677 --- ParallelTerminationStrategy: PID 29072 died... 10:29:25.449291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29072): Terminated: ok {rc=0} 10:29:25.493743 --- ParallelTerminationStrategy: PID 29075 died... 10:29:25.512647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29075): Terminated: ok {rc=0} 10:29:25.599169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:29:26.686362 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:26.697958 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:29:26.748736 tst ping_idle_ping.py: using LAC 27765 10:29:26.878285 tst ping_idle_ping.py: using RAC 225 10:29:27.005769 tst ping_idle_ping.py: using CellId 27765 10:29:27.132371 tst ping_idle_ping.py: using BVCI 27766 10:29:27.249426 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:27.260931 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:27.272748 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:27.284563 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:27.296537 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:27.308315 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:27.320837 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:29:27.332463 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:29:27.449988 tst ping_idle_ping.py:24: start network... 10:29:27.653249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:28.120406 run create_hlr_db(pid=29077): Launched 10:29:28.244438 bus /gobi_6: Setting Powered False 10:29:29.306611 run create_hlr_db(pid=29077): Terminated: ok {rc=0} 10:29:29.749209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Launched 10:29:30.072600 run osmo-hlr_10.42.42.2(pid=29080): Launched 10:29:30.197112 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:30.754326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Launched 10:29:31.101680 run osmo-stp_10.42.42.5(pid=29083): Launched 10:29:31.336390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:32.019385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Launched 10:29:32.145917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:32.403847 run patchelf(pid=29086): Launched 10:29:32.572826 run osmo-stp_10.42.42.5(pid=29083): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] 10:29:32.701702 run osmo-stp_10.42.42.5(pid=29083): stdout: | (launched: 2022-12-10_10:29:31.034861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:32.831249 run osmo-stp_10.42.42.5(pid=29083): stderr: | 20221210102931355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102931356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102931356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102931356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102931357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102931357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102931357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:32.960480 run osmo-stp_10.42.42.5(pid=29083): stdout: | (launched: 2022-12-10_10:29:31.034861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:33.084355 run osmo-stp_10.42.42.5(pid=29083): stderr: | 20221210102931355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102931356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102931356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102931356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102931357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102931357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102931357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:33.230797 run patchelf(pid=29086): Terminating (SIGINT) 10:29:33.400245 run patchelf(pid=29086): Terminated: ok {rc=0} 10:29:33.522345 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29083): Process ended prematurely: osmo-stp_10.42.42.5(pid=29083) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 10:29:33.531195 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:29:33.558209 run osmo-hlr_10.42.42.2(pid=29080): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29080)] 10:29:33.606003 run osmo-hlr_10.42.42.2(pid=29080): stdout: | (launched: 2022-12-10_10:29:30.014293) 10:29:33.655634 run osmo-hlr_10.42.42.2(pid=29080): stderr: | 20221210102930211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102930211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102930211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102930211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102930211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102930211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102930222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102930230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102930231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102930231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:33.705673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Terminating (SIGTERM) 10:29:33.745986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Terminating (SIGTERM) 10:29:33.786239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Terminating (SIGTERM) 10:29:33.826718 --- ParallelTerminationStrategy: PID 29079 died... 10:29:33.846079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29079): Terminated: ok {rc=0} 10:29:33.890658 --- ParallelTerminationStrategy: PID 29082 died... 10:29:33.909627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29082): Terminated: ok {rc=0} 10:29:33.954418 --- ParallelTerminationStrategy: PID 29085 died... 10:29:33.973722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29085): Terminated: ok {rc=0} 10:29:34.060163 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:29:35.361837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:29:35.368093 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:29:35.401390 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:29:35.439987 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:29:35.526560 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:29:35.558758 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:29:35.597103 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:29:36.194016 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:29:36.245381 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.256322 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:29:36.324605 tst cs_paging_gprs_active.py: using LAC 27766 10:29:36.448292 tst cs_paging_gprs_active.py: using RAC 226 10:29:36.568456 tst cs_paging_gprs_active.py: using CellId 27766 10:29:36.693329 tst cs_paging_gprs_active.py: using BVCI 27767 10:29:36.805638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.816437 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.827257 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.838025 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.848611 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.859302 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.870134 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.880785 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:36.891667 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:37.006797 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:37.127816 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:29:37.351307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:37.680930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29091): Launched 10:29:37.969426 run iperf3-srv_10.42.42.10(pid=29092): Launched 10:29:38.093832 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:29:38.317920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:38.649684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29093): Launched 10:29:38.935742 run iperf3-srv_10.42.42.10(pid=29094): Launched 10:29:39.059566 tst cs_paging_gprs_active.py:38: start network... 10:29:39.282418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:39.791307 run create_hlr_db(pid=29095): Launched 10:29:39.917755 bus /gobi_6: Setting Powered False 10:29:40.982526 run create_hlr_db(pid=29095): Terminated: ok {rc=0} 10:29:41.420713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29097): Launched 10:29:41.728751 run osmo-hlr_10.42.42.2(pid=29098): Launched 10:29:41.846733 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:42.393190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29100): Launched 10:29:42.700585 run osmo-stp_10.42.42.5(pid=29101): Launched 10:29:42.819018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:43.349196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29103): Launched 10:29:43.466809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:43.732208 run patchelf(pid=29104): Launched 10:29:43.903613 run osmo-stp_10.42.42.5(pid=29101): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29101)] 10:29:44.033208 run osmo-stp_10.42.42.5(pid=29101): stdout: | (launched: 2022-12-10_10:29:42.644479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:44.163924 run osmo-stp_10.42.42.5(pid=29101): stderr: | 20221210102942816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102942816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102942816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102942817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102942817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102942817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102942817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:44.294756 run osmo-stp_10.42.42.5(pid=29101): stdout: | (launched: 2022-12-10_10:29:42.644479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:44.419956 run osmo-stp_10.42.42.5(pid=29101): stderr: | 20221210102942816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102942816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102942816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102942817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102942817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102942817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102942817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:44.568293 run patchelf(pid=29104): Terminating (SIGINT) 10:29:44.741427 run patchelf(pid=29104): Terminated: ok {rc=0} 10:29:44.865592 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29101): Process ended prematurely: osmo-stp_10.42.42.5(pid=29101) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29101)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:29:44.874910 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:29:44.902086 run osmo-hlr_10.42.42.2(pid=29098): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29098)] 10:29:44.949634 run osmo-hlr_10.42.42.2(pid=29098): stdout: | (launched: 2022-12-10_10:29:41.672608) 10:29:44.998744 run osmo-hlr_10.42.42.2(pid=29098): stderr: | 20221210102941851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102941852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102941852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102941852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102941852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102941852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102941864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102941872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102941873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102941873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:45.048486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29091): Terminating (SIGTERM) 10:29:45.088186 run iperf3-srv_10.42.42.10(pid=29092): Terminating (SIGTERM) 10:29:45.127832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29093): Terminating (SIGTERM) 10:29:45.167470 run iperf3-srv_10.42.42.10(pid=29094): Terminating (SIGTERM) 10:29:45.207876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29097): Terminating (SIGTERM) 10:29:45.251686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29100): Terminating (SIGTERM) 10:29:45.294738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29103): Terminating (SIGTERM) 10:29:45.337664 --- ParallelTerminationStrategy: PID 29091 died... 10:29:45.357789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29091): Terminated: ok {rc=0} 10:29:45.404999 --- ParallelTerminationStrategy: PID 29092 died... 10:29:45.424820 run iperf3-srv_10.42.42.10(pid=29092): Terminated {rc=256} 10:29:45.471794 --- ParallelTerminationStrategy: PID 29093 died... 10:29:45.491509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29093): Terminated: ok {rc=0} 10:29:45.538561 --- ParallelTerminationStrategy: PID 29094 died... 10:29:45.558567 run iperf3-srv_10.42.42.10(pid=29094): Terminated {rc=256} 10:29:45.605560 --- ParallelTerminationStrategy: PID 29097 died... 10:29:45.625283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29097): Terminated: ok {rc=0} 10:29:45.672484 --- ParallelTerminationStrategy: PID 29100 died... 10:29:45.692302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29100): Terminated: ok {rc=0} 10:29:45.739498 --- ParallelTerminationStrategy: PID 29103 died... 10:29:45.759225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29103): Terminated: ok {rc=0} 10:29:45.853167 bus /gobi_0: Setting Powered False 10:29:46.967263 bus /gobi_0: Setting Powered False 10:29:48.086750 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:29:49.234865 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.246363 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:29:49.315214 tst iperf3.py: using LAC 27767 10:29:49.435397 tst iperf3.py: using RAC 227 10:29:49.555731 tst iperf3.py: using CellId 27767 10:29:49.675280 tst iperf3.py: using BVCI 27768 10:29:49.787637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.798497 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.809329 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.819935 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.830501 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.841152 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.852106 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.862637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:49.873346 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:49.992616 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:29:50.213866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:29:50.541555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29105): Launched 10:29:50.827640 run iperf3-srv_10.42.42.10(pid=29106): Launched 10:29:50.950989 tst iperf3.py:8: start network... 10:29:51.171795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:29:51.677642 run create_hlr_db(pid=29107): Launched 10:29:51.803917 bus /gobi_6: Setting Powered False 10:29:52.867820 run create_hlr_db(pid=29107): Terminated: ok {rc=0} 10:29:53.305283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29109): Launched 10:29:53.610294 run osmo-hlr_10.42.42.2(pid=29110): Launched 10:29:53.727520 run osmo-stp_10.42.42.5: Starting osmo-stp 10:29:54.362500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29112): Launched 10:29:54.660144 run osmo-stp_10.42.42.5(pid=29113): Launched 10:29:54.775021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:29:55.291392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29115): Launched 10:29:55.406272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:29:55.657890 run patchelf(pid=29116): Launched 10:29:55.824678 run osmo-stp_10.42.42.5(pid=29113): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29113)] 10:29:55.951541 run osmo-stp_10.42.42.5(pid=29113): stdout: | (launched: 2022-12-10_10:29:54.605732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:56.079876 run osmo-stp_10.42.42.5(pid=29113): stderr: | 20221210102954778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102954778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102954778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102954779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102954779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102954779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102954779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:56.208497 run osmo-stp_10.42.42.5(pid=29113): stdout: | (launched: 2022-12-10_10:29:54.605732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:29:56.331107 run osmo-stp_10.42.42.5(pid=29113): stderr: | 20221210102954778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210102954778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210102954778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210102954779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210102954779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210102954779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210102954779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:29:56.477072 run patchelf(pid=29116): Terminating (SIGINT) 10:29:56.645604 run patchelf(pid=29116): Terminated: ok {rc=0} 10:29:56.767749 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29113): Process ended prematurely: osmo-stp_10.42.42.5(pid=29113) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29113)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 10:29:56.777140 tst iperf3.py:8: Test FAILED (7.6 sec) 10:29:56.804138 run osmo-hlr_10.42.42.2(pid=29110): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29110)] 10:29:56.851093 run osmo-hlr_10.42.42.2(pid=29110): stdout: | (launched: 2022-12-10_10:29:53.554790) 10:29:56.899550 run osmo-hlr_10.42.42.2(pid=29110): stderr: | 20221210102953732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210102953732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210102953732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210102953732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210102953732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210102953732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210102953744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210102953754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210102953754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210102953754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:29:56.948448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29105): Terminating (SIGTERM) 10:29:56.987625 run iperf3-srv_10.42.42.10(pid=29106): Terminating (SIGTERM) 10:29:57.026824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29109): Terminating (SIGTERM) 10:29:57.066076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29112): Terminating (SIGTERM) 10:29:57.105540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29115): Terminating (SIGTERM) 10:29:57.145085 --- ParallelTerminationStrategy: PID 29105 died... 10:29:57.163849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29105): Terminated: ok {rc=0} 10:29:57.207354 --- ParallelTerminationStrategy: PID 29106 died... 10:29:57.225876 run iperf3-srv_10.42.42.10(pid=29106): Terminated {rc=256} 10:29:57.269359 --- ParallelTerminationStrategy: PID 29109 died... 10:29:57.287930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29109): Terminated: ok {rc=0} 10:29:57.331343 --- ParallelTerminationStrategy: PID 29112 died... 10:29:57.349667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29112): Terminated: ok {rc=0} 10:29:57.393078 --- ParallelTerminationStrategy: PID 29115 died... 10:29:57.411447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29115): Terminated: ok {rc=0} 10:29:57.497132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:29:58.644080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:58.655493 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:29:58.726146 tst iperf3m4.py: using LAC 27768 10:29:58.845706 tst iperf3m4.py: using RAC 228 10:29:58.962184 tst iperf3m4.py: using CellId 27768 10:29:59.079859 tst iperf3m4.py: using BVCI 27769 10:29:59.189993 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.200697 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.211375 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.222047 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.232647 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.243405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.254147 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.264641 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:29:59.275426 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:59.388566 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:59.504680 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:59.624553 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:29:59.744559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:29:59.960404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:00.281477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Launched 10:30:00.562047 run iperf3-srv_10.42.42.10(pid=29118): Launched 10:30:00.681971 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:30:00.918127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:01.263484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29122): Launched 10:30:01.550125 run iperf3-srv_10.42.42.10(pid=29123): Launched 10:30:01.680160 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:30:01.908637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:02.236561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29124): Launched 10:30:02.506374 run iperf3-srv_10.42.42.10(pid=29125): Launched 10:30:02.619689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:30:02.820904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:03.120908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Launched 10:30:03.382013 run iperf3-srv_10.42.42.10(pid=29127): Launched 10:30:03.493839 tst iperf3m4.py:8: start network... 10:30:03.693698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:04.159537 run create_hlr_db(pid=29128): Launched 10:30:04.282685 bus /gobi_6: Setting Powered False 10:30:05.342850 run create_hlr_db(pid=29128): Terminated: ok {rc=0} 10:30:05.781707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Launched 10:30:06.103196 run osmo-hlr_10.42.42.2(pid=29131): Launched 10:30:06.225910 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:06.758429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Launched 10:30:07.058108 run osmo-stp_10.42.42.5(pid=29134): Launched 10:30:07.171553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:07.687849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Launched 10:30:07.802649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:08.055102 run patchelf(pid=29137): Launched 10:30:08.222031 run osmo-stp_10.42.42.5(pid=29134): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] 10:30:08.349353 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-10_10:30:07.003777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:08.478324 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221210103007173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103007173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103007174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103007174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103007176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103007176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103007176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:08.606943 run osmo-stp_10.42.42.5(pid=29134): stdout: | (launched: 2022-12-10_10:30:07.003777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:08.729707 run osmo-stp_10.42.42.5(pid=29134): stderr: | 20221210103007173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103007173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103007174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103007174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103007176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103007176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103007176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:08.875837 run patchelf(pid=29137): Terminating (SIGINT) 10:30:09.044126 run patchelf(pid=29137): Terminated: ok {rc=0} 10:30:09.166305 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:30:09.175760 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:30:09.203102 run osmo-hlr_10.42.42.2(pid=29131): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29131)] 10:30:09.250454 run osmo-hlr_10.42.42.2(pid=29131): stdout: | (launched: 2022-12-10_10:30:06.044901) 10:30:09.299674 run osmo-hlr_10.42.42.2(pid=29131): stderr: | 20221210103006243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103006243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103006243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103006243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103006243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103006243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103006255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103006263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103006263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103006263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:09.349411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Terminating (SIGTERM) 10:30:09.389058 run iperf3-srv_10.42.42.10(pid=29118): Terminating (SIGTERM) 10:30:09.428554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29122): Terminating (SIGTERM) 10:30:09.467925 run iperf3-srv_10.42.42.10(pid=29123): Terminating (SIGTERM) 10:30:09.507151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29124): Terminating (SIGTERM) 10:30:09.546518 run iperf3-srv_10.42.42.10(pid=29125): Terminating (SIGTERM) 10:30:09.585850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Terminating (SIGTERM) 10:30:09.625216 run iperf3-srv_10.42.42.10(pid=29127): Terminating (SIGTERM) 10:30:09.664412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminating (SIGTERM) 10:30:09.704110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminating (SIGTERM) 10:30:09.743432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminating (SIGTERM) 10:30:09.783074 --- ParallelTerminationStrategy: PID 29117 died... 10:30:09.802024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Terminated: ok {rc=0} 10:30:09.845697 --- ParallelTerminationStrategy: PID 29118 died... 10:30:09.863945 run iperf3-srv_10.42.42.10(pid=29118): Terminated {rc=256} 10:30:09.907260 --- ParallelTerminationStrategy: PID 29122 died... 10:30:09.925633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29122): Terminated: ok {rc=0} 10:30:09.969139 --- ParallelTerminationStrategy: PID 29123 died... 10:30:09.987430 run iperf3-srv_10.42.42.10(pid=29123): Terminated {rc=256} 10:30:10.030774 --- ParallelTerminationStrategy: PID 29124 died... 10:30:10.049320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29124): Terminated: ok {rc=0} 10:30:10.093462 --- ParallelTerminationStrategy: PID 29125 died... 10:30:10.111784 run iperf3-srv_10.42.42.10(pid=29125): Terminated {rc=256} 10:30:10.155408 --- ParallelTerminationStrategy: PID 29126 died... 10:30:10.173857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29126): Terminated: ok {rc=0} 10:30:10.217390 --- ParallelTerminationStrategy: PID 29127 died... 10:30:10.236344 run iperf3-srv_10.42.42.10(pid=29127): Terminated {rc=256} 10:30:10.280169 --- ParallelTerminationStrategy: PID 29130 died... 10:30:10.298595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29130): Terminated: ok {rc=0} 10:30:10.342077 --- ParallelTerminationStrategy: PID 29133 died... 10:30:10.360361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29133): Terminated: ok {rc=0} 10:30:10.404143 --- ParallelTerminationStrategy: PID 29136 died... 10:30:10.422719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29136): Terminated: ok {rc=0} 10:30:10.508534 bus /gobi_4: Setting Powered False 10:30:11.607271 bus /gobi_4: Setting Powered False 10:30:12.719495 bus /gobi_1: Setting Powered False 10:30:13.816455 bus /gobi_1: Setting Powered False 10:30:14.932089 bus /gobi_0: Setting Powered False 10:30:16.028723 bus /gobi_0: Setting Powered False 10:30:17.154002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:30:18.260038 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.271870 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:30:18.344286 tst ping.py: using LAC 27769 10:30:18.470577 tst ping.py: using RAC 229 10:30:18.595367 tst ping.py: using CellId 27769 10:30:18.718432 tst ping.py: using BVCI 27770 10:30:18.833233 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.844501 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.855735 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.867199 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.878623 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.890078 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.901571 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:18.912806 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:19.028933 tst ping.py:19: start network... 10:30:19.227501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:19.687020 run create_hlr_db(pid=29138): Launched 10:30:19.800079 bus /gobi_6: Setting Powered False 10:30:20.859897 run create_hlr_db(pid=29138): Terminated: ok {rc=0} 10:30:21.293413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Launched 10:30:21.608928 run osmo-hlr_10.42.42.2(pid=29141): Launched 10:30:21.730352 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:22.276651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Launched 10:30:22.592037 run osmo-stp_10.42.42.5(pid=29144): Launched 10:30:22.712887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:23.256375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Launched 10:30:23.378701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:23.643682 run patchelf(pid=29147): Launched 10:30:23.819130 run osmo-stp_10.42.42.5(pid=29144): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] 10:30:23.952918 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-10_10:30:22.534979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:24.088683 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221210103022725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103022725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103022725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103022726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103022726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103022726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103022726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:24.224097 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-10_10:30:22.534979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:24.354568 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221210103022725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103022725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103022725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103022726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103022726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103022726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103022726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:24.508174 run patchelf(pid=29147): Terminating (SIGINT) 10:30:24.685235 run patchelf(pid=29147): Terminated: ok {rc=0} 10:30:24.812778 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 10:30:24.822359 tst ping.py:22: Test FAILED (6.6 sec) 10:30:24.850671 run osmo-hlr_10.42.42.2(pid=29141): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29141)] 10:30:24.901383 run osmo-hlr_10.42.42.2(pid=29141): stdout: | (launched: 2022-12-10_10:30:21.551964) 10:30:24.953550 run osmo-hlr_10.42.42.2(pid=29141): stderr: | 20221210103021749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103021749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103021749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103021749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103021749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103021750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103021762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103021770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103021771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103021771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:25.006303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminating (SIGTERM) 10:30:25.048271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminating (SIGTERM) 10:30:25.090480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminating (SIGTERM) 10:30:25.132791 --- ParallelTerminationStrategy: PID 29140 died... 10:30:25.152715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminated: ok {rc=0} 10:30:25.199327 --- ParallelTerminationStrategy: PID 29143 died... 10:30:25.218701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminated: ok {rc=0} 10:30:25.264886 --- ParallelTerminationStrategy: PID 29146 died... 10:30:25.284367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminated: ok {rc=0} 10:30:25.372092 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:30:26.459519 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:26.471454 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:30:26.543087 tst ping_idle_ping.py: using LAC 27770 10:30:26.658785 tst ping_idle_ping.py: using RAC 230 10:30:26.781365 tst ping_idle_ping.py: using CellId 27770 10:30:26.905610 tst ping_idle_ping.py: using BVCI 27771 10:30:27.019948 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:27.031394 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:27.042687 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:27.054204 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:27.065750 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:27.077301 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:27.088798 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:30:27.100268 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:30:27.218614 tst ping_idle_ping.py:24: start network... 10:30:27.432537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:27.919325 run create_hlr_db(pid=29148): Launched 10:30:28.047725 bus /gobi_6: Setting Powered False 10:30:29.110149 run create_hlr_db(pid=29148): Terminated: ok {rc=0} 10:30:29.533668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Launched 10:30:29.831693 run osmo-hlr_10.42.42.2(pid=29151): Launched 10:30:29.944888 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:30.469481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Launched 10:30:30.769063 run osmo-stp_10.42.42.5(pid=29154): Launched 10:30:30.916654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:31.577815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Launched 10:30:31.699418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:31.964500 run patchelf(pid=29157): Launched 10:30:32.146038 run osmo-stp_10.42.42.5(pid=29154): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] 10:30:32.273575 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-10_10:30:30.714920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:32.401356 run osmo-stp_10.42.42.5(pid=29154): stderr: | 20221210103030940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103030940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103030941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103030941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103030942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103030942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103030942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:32.529382 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-10_10:30:30.714920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:32.651409 run osmo-stp_10.42.42.5(pid=29154): stderr: | 20221210103030940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103030940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103030941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103030941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103030942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103030942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103030942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:32.796530 run patchelf(pid=29157): Terminating (SIGINT) 10:30:32.965489 run patchelf(pid=29157): Terminated: ok {rc=0} 10:30:33.087704 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:30:33.096820 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:30:33.123991 run osmo-hlr_10.42.42.2(pid=29151): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29151)] 10:30:33.171960 run osmo-hlr_10.42.42.2(pid=29151): stdout: | (launched: 2022-12-10_10:30:29.777834) 10:30:33.221800 run osmo-hlr_10.42.42.2(pid=29151): stderr: | 20221210103029955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103029955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103029956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103029956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103029956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103029956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103029971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103029981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103029981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103029981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:33.271833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminating (SIGTERM) 10:30:33.311868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminating (SIGTERM) 10:30:33.351764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminating (SIGTERM) 10:30:33.391859 --- ParallelTerminationStrategy: PID 29150 died... 10:30:33.410872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminated: ok {rc=0} 10:30:33.455519 --- ParallelTerminationStrategy: PID 29153 died... 10:30:33.474327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminated: ok {rc=0} 10:30:33.518337 --- ParallelTerminationStrategy: PID 29156 died... 10:30:33.537109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminated: ok {rc=0} 10:30:33.622167 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:30:34.922980 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:30:34.929233 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:30:34.961601 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:30:34.999945 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:30:35.086320 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:30:35.118293 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:30:35.156115 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:30:35.750892 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:30:35.799323 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:35.810249 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:30:35.882622 tst cs_paging_gprs_active.py: using LAC 27771 10:30:36.000273 tst cs_paging_gprs_active.py: using RAC 231 10:30:36.117201 tst cs_paging_gprs_active.py: using CellId 27771 10:30:36.235052 tst cs_paging_gprs_active.py: using BVCI 27772 10:30:36.344060 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.354884 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.365585 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.376255 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.386839 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.397535 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.408204 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.418820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:36.429572 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:36.549249 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:36.670348 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:30:36.875143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:37.180589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29161): Launched 10:30:37.444716 run iperf3-srv_10.42.42.10(pid=29162): Launched 10:30:37.559208 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:30:37.762201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:38.065599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29163): Launched 10:30:38.329915 run iperf3-srv_10.42.42.10(pid=29164): Launched 10:30:38.442936 tst cs_paging_gprs_active.py:38: start network... 10:30:38.645490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:39.114541 run create_hlr_db(pid=29165): Launched 10:30:39.238767 bus /gobi_6: Setting Powered False 10:30:40.298583 run create_hlr_db(pid=29165): Terminated: ok {rc=0} 10:30:40.736872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29167): Launched 10:30:41.058167 run osmo-hlr_10.42.42.2(pid=29168): Launched 10:30:41.181297 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:41.732704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29170): Launched 10:30:42.053732 run osmo-stp_10.42.42.5(pid=29171): Launched 10:30:42.177045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:42.732535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29173): Launched 10:30:42.856561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:43.130032 run patchelf(pid=29174): Launched 10:30:43.310246 run osmo-stp_10.42.42.5(pid=29171): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29171)] 10:30:43.446821 run osmo-stp_10.42.42.5(pid=29171): stdout: | (launched: 2022-12-10_10:30:41.995964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:43.584333 run osmo-stp_10.42.42.5(pid=29171): stderr: | 20221210103042186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103042186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103042187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103042187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103042189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103042190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103042190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:43.722228 run osmo-stp_10.42.42.5(pid=29171): stdout: | (launched: 2022-12-10_10:30:41.995964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:43.853839 run osmo-stp_10.42.42.5(pid=29171): stderr: | 20221210103042186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103042186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103042187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103042187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103042189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103042190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103042190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:44.009891 run patchelf(pid=29174): Terminating (SIGINT) 10:30:44.191184 run patchelf(pid=29174): Terminated: ok {rc=0} 10:30:44.322035 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29171): Process ended prematurely: osmo-stp_10.42.42.5(pid=29171) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29171)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:30:44.332193 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:30:44.361596 run osmo-hlr_10.42.42.2(pid=29168): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29168)] 10:30:44.411941 run osmo-hlr_10.42.42.2(pid=29168): stdout: | (launched: 2022-12-10_10:30:41.000427) 10:30:44.464065 run osmo-hlr_10.42.42.2(pid=29168): stderr: | 20221210103041197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103041197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103041197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103041197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103041198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103041198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103041209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103041218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103041218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103041218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:44.516407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29161): Terminating (SIGTERM) 10:30:44.558612 run iperf3-srv_10.42.42.10(pid=29162): Terminating (SIGTERM) 10:30:44.600829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29163): Terminating (SIGTERM) 10:30:44.643399 run iperf3-srv_10.42.42.10(pid=29164): Terminating (SIGTERM) 10:30:44.685654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29167): Terminating (SIGTERM) 10:30:44.727908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29170): Terminating (SIGTERM) 10:30:44.770231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29173): Terminating (SIGTERM) 10:30:44.812621 --- ParallelTerminationStrategy: PID 29161 died... 10:30:44.832712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29161): Terminated: ok {rc=0} 10:30:44.879908 --- ParallelTerminationStrategy: PID 29162 died... 10:30:44.899520 run iperf3-srv_10.42.42.10(pid=29162): Terminated {rc=256} 10:30:44.946017 --- ParallelTerminationStrategy: PID 29163 died... 10:30:44.965440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29163): Terminated: ok {rc=0} 10:30:45.012058 --- ParallelTerminationStrategy: PID 29164 died... 10:30:45.031492 run iperf3-srv_10.42.42.10(pid=29164): Terminated {rc=256} 10:30:45.078196 --- ParallelTerminationStrategy: PID 29167 died... 10:30:45.097615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29167): Terminated: ok {rc=0} 10:30:45.144571 --- ParallelTerminationStrategy: PID 29170 died... 10:30:45.164332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29170): Terminated: ok {rc=0} 10:30:45.210998 --- ParallelTerminationStrategy: PID 29173 died... 10:30:45.230627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29173): Terminated: ok {rc=0} 10:30:45.318041 bus /gobi_0: Setting Powered False 10:30:46.414032 bus /gobi_0: Setting Powered False 10:30:47.534512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:30:48.680306 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:48.691859 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:30:48.762046 tst iperf3.py: using LAC 27772 10:30:48.890234 tst iperf3.py: using RAC 232 10:30:49.016398 tst iperf3.py: using CellId 27772 10:30:49.142705 tst iperf3.py: using BVCI 27773 10:30:49.261018 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.272536 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.283743 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.295166 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.306465 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.318378 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.330022 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.341423 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:49.352847 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:49.468678 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:30:49.670872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:49.971678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29175): Launched 10:30:50.234242 run iperf3-srv_10.42.42.10(pid=29176): Launched 10:30:50.347303 tst iperf3.py:8: start network... 10:30:50.547150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:30:51.010907 run create_hlr_db(pid=29177): Launched 10:30:51.134562 bus /gobi_6: Setting Powered False 10:30:52.195082 run create_hlr_db(pid=29177): Terminated: ok {rc=0} 10:30:52.632739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29179): Launched 10:30:52.955463 run osmo-hlr_10.42.42.2(pid=29180): Launched 10:30:53.078148 run osmo-stp_10.42.42.5: Starting osmo-stp 10:30:53.636543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29182): Launched 10:30:53.956410 run osmo-stp_10.42.42.5(pid=29183): Launched 10:30:54.079152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:30:54.635870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29185): Launched 10:30:54.759227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:30:55.029721 run patchelf(pid=29186): Launched 10:30:55.209209 run osmo-stp_10.42.42.5(pid=29183): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29183)] 10:30:55.346611 run osmo-stp_10.42.42.5(pid=29183): stdout: | (launched: 2022-12-10_10:30:53.898410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:55.485111 run osmo-stp_10.42.42.5(pid=29183): stderr: | 20221210103054090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103054090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103054090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103054090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103054091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103054091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103054091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:55.623524 run osmo-stp_10.42.42.5(pid=29183): stdout: | (launched: 2022-12-10_10:30:53.898410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:30:55.755410 run osmo-stp_10.42.42.5(pid=29183): stderr: | 20221210103054090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103054090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103054090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103054090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103054091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103054091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103054091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:30:55.912176 run patchelf(pid=29186): Terminating (SIGINT) 10:30:56.093657 run patchelf(pid=29186): Terminated: ok {rc=0} 10:30:56.224474 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29183): Process ended prematurely: osmo-stp_10.42.42.5(pid=29183) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29183)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 10:30:56.234651 tst iperf3.py:8: Test FAILED (7.6 sec) 10:30:56.263840 run osmo-hlr_10.42.42.2(pid=29180): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29180)] 10:30:56.314726 run osmo-hlr_10.42.42.2(pid=29180): stdout: | (launched: 2022-12-10_10:30:52.897144) 10:30:56.367042 run osmo-hlr_10.42.42.2(pid=29180): stderr: | 20221210103053097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103053097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103053097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103053097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103053097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103053097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103053110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103053118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103053118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103053118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:30:56.419528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29175): Terminating (SIGTERM) 10:30:56.461806 run iperf3-srv_10.42.42.10(pid=29176): Terminating (SIGTERM) 10:30:56.504243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29179): Terminating (SIGTERM) 10:30:56.546654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29182): Terminating (SIGTERM) 10:30:56.589315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29185): Terminating (SIGTERM) 10:30:56.631840 --- ParallelTerminationStrategy: PID 29175 died... 10:30:56.652034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29175): Terminated: ok {rc=0} 10:30:56.699258 --- ParallelTerminationStrategy: PID 29176 died... 10:30:56.718862 run iperf3-srv_10.42.42.10(pid=29176): Terminated {rc=256} 10:30:56.765590 --- ParallelTerminationStrategy: PID 29179 died... 10:30:56.785208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29179): Terminated: ok {rc=0} 10:30:56.831957 --- ParallelTerminationStrategy: PID 29182 died... 10:30:56.851525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29182): Terminated: ok {rc=0} 10:30:56.898655 --- ParallelTerminationStrategy: PID 29185 died... 10:30:56.918303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29185): Terminated: ok {rc=0} 10:30:57.007097 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:30:58.160289 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.172478 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:30:58.244908 tst iperf3m4.py: using LAC 27773 10:30:58.373070 tst iperf3m4.py: using RAC 233 10:30:58.498335 tst iperf3m4.py: using CellId 27773 10:30:58.624738 tst iperf3m4.py: using BVCI 27774 10:30:58.743018 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.754468 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.765669 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.777208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.788517 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.799959 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.811521 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.822986 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:30:58.834709 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:58.957925 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:59.078909 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:59.199279 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:30:59.320119 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:30:59.538587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:30:59.860610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29187): Launched 10:31:00.140845 run iperf3-srv_10.42.42.10(pid=29188): Launched 10:31:00.261669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:31:00.478872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:00.800171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29189): Launched 10:31:01.103625 run iperf3-srv_10.42.42.10(pid=29190): Launched 10:31:01.239279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:31:01.460517 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:01.789853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29191): Launched 10:31:02.093976 run iperf3-srv_10.42.42.10(pid=29192): Launched 10:31:02.219903 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:31:02.421937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:02.724259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29193): Launched 10:31:02.988224 run iperf3-srv_10.42.42.10(pid=29194): Launched 10:31:03.101365 tst iperf3m4.py:8: start network... 10:31:03.303005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:03.769559 run create_hlr_db(pid=29195): Launched 10:31:03.892914 bus /gobi_6: Setting Powered False 10:31:04.952912 run create_hlr_db(pid=29195): Terminated: ok {rc=0} 10:31:05.374233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29197): Launched 10:31:05.676830 run osmo-hlr_10.42.42.2(pid=29198): Launched 10:31:05.791537 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:06.324234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29200): Launched 10:31:06.626041 run osmo-stp_10.42.42.5(pid=29201): Launched 10:31:06.740136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:07.257538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29203): Launched 10:31:07.374242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:07.627999 run patchelf(pid=29204): Launched 10:31:07.795263 run osmo-stp_10.42.42.5(pid=29201): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29201)] 10:31:07.922175 run osmo-stp_10.42.42.5(pid=29201): stdout: | (launched: 2022-12-10_10:31:06.570769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:08.051233 run osmo-stp_10.42.42.5(pid=29201): stderr: | 20221210103106741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103106742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103106742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103106742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103106743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103106743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103106743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:08.180386 run osmo-stp_10.42.42.5(pid=29201): stdout: | (launched: 2022-12-10_10:31:06.570769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:08.303503 run osmo-stp_10.42.42.5(pid=29201): stderr: | 20221210103106741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103106742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103106742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103106742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103106743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103106743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103106743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:08.449488 run patchelf(pid=29204): Terminating (SIGINT) 10:31:08.618676 run patchelf(pid=29204): Terminated: ok {rc=0} 10:31:08.740864 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29201): Process ended prematurely: osmo-stp_10.42.42.5(pid=29201) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29201)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:31:08.750372 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:31:08.777658 run osmo-hlr_10.42.42.2(pid=29198): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29198)] 10:31:08.824682 run osmo-hlr_10.42.42.2(pid=29198): stdout: | (launched: 2022-12-10_10:31:05.621259) 10:31:08.874235 run osmo-hlr_10.42.42.2(pid=29198): stderr: | 20221210103105798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103105798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103105798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103105798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103105799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103105799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103105811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103105820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103105820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103105820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:08.923673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29187): Terminating (SIGTERM) 10:31:08.963317 run iperf3-srv_10.42.42.10(pid=29188): Terminating (SIGTERM) 10:31:09.002878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29189): Terminating (SIGTERM) 10:31:09.042463 run iperf3-srv_10.42.42.10(pid=29190): Terminating (SIGTERM) 10:31:09.081783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29191): Terminating (SIGTERM) 10:31:09.121262 run iperf3-srv_10.42.42.10(pid=29192): Terminating (SIGTERM) 10:31:09.160710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29193): Terminating (SIGTERM) 10:31:09.200286 run iperf3-srv_10.42.42.10(pid=29194): Terminating (SIGTERM) 10:31:09.239616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29197): Terminating (SIGTERM) 10:31:09.279138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29200): Terminating (SIGTERM) 10:31:09.318550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29203): Terminating (SIGTERM) 10:31:09.358732 --- ParallelTerminationStrategy: PID 29187 died... 10:31:09.377782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29187): Terminated: ok {rc=0} 10:31:09.421570 --- ParallelTerminationStrategy: PID 29188 died... 10:31:09.439877 run iperf3-srv_10.42.42.10(pid=29188): Terminated {rc=256} 10:31:09.483962 --- ParallelTerminationStrategy: PID 29189 died... 10:31:09.502356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29189): Terminated: ok {rc=0} 10:31:09.545828 --- ParallelTerminationStrategy: PID 29190 died... 10:31:09.564147 run iperf3-srv_10.42.42.10(pid=29190): Terminated {rc=256} 10:31:09.607561 --- ParallelTerminationStrategy: PID 29191 died... 10:31:09.626035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29191): Terminated: ok {rc=0} 10:31:09.670136 --- ParallelTerminationStrategy: PID 29192 died... 10:31:09.688570 run iperf3-srv_10.42.42.10(pid=29192): Terminated {rc=256} 10:31:09.731923 --- ParallelTerminationStrategy: PID 29193 died... 10:31:09.750247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29193): Terminated: ok {rc=0} 10:31:09.793638 --- ParallelTerminationStrategy: PID 29194 died... 10:31:09.812204 run iperf3-srv_10.42.42.10(pid=29194): Terminated {rc=256} 10:31:09.855542 --- ParallelTerminationStrategy: PID 29197 died... 10:31:09.873950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29197): Terminated: ok {rc=0} 10:31:09.918002 --- ParallelTerminationStrategy: PID 29200 died... 10:31:09.936439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29200): Terminated: ok {rc=0} 10:31:09.980036 --- ParallelTerminationStrategy: PID 29203 died... 10:31:09.998597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29203): Terminated: ok {rc=0} 10:31:10.083851 bus /gobi_4: Setting Powered False 10:31:11.184370 bus /gobi_4: Setting Powered False 10:31:12.299827 bus /gobi_1: Setting Powered False 10:31:13.399363 bus /gobi_1: Setting Powered False 10:31:14.514158 bus /gobi_0: Setting Powered False 10:31:15.612677 bus /gobi_0: Setting Powered False 10:31:16.731428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:31:17.834023 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:17.845681 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:31:17.916389 tst ping.py: using LAC 27774 10:31:18.033418 tst ping.py: using RAC 234 10:31:18.149421 tst ping.py: using CellId 27774 10:31:18.274436 tst ping.py: using BVCI 27775 10:31:18.389520 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:18.400868 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:18.412316 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:18.424050 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:18.435702 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:18.447343 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:18.459012 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:18.470596 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:18.585574 tst ping.py:19: start network... 10:31:18.798625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:19.287057 run create_hlr_db(pid=29205): Launched 10:31:19.408628 bus /gobi_6: Setting Powered False 10:31:20.472130 run create_hlr_db(pid=29205): Terminated: ok {rc=0} 10:31:20.913542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29207): Launched 10:31:21.230392 run osmo-hlr_10.42.42.2(pid=29208): Launched 10:31:21.352156 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:21.898804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29210): Launched 10:31:22.215305 run osmo-stp_10.42.42.5(pid=29211): Launched 10:31:22.336550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:22.879542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29213): Launched 10:31:23.001021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:23.266703 run patchelf(pid=29214): Launched 10:31:23.442726 run osmo-stp_10.42.42.5(pid=29211): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29211)] 10:31:23.577061 run osmo-stp_10.42.42.5(pid=29211): stdout: | (launched: 2022-12-10_10:31:22.158066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:23.712562 run osmo-stp_10.42.42.5(pid=29211): stderr: | 20221210103122348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103122350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103122350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103122350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103122351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103122351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103122351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:23.848410 run osmo-stp_10.42.42.5(pid=29211): stdout: | (launched: 2022-12-10_10:31:22.158066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:23.978286 run osmo-stp_10.42.42.5(pid=29211): stderr: | 20221210103122348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103122350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103122350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103122350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103122351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103122351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103122351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:24.132041 run patchelf(pid=29214): Terminating (SIGINT) 10:31:24.309494 run patchelf(pid=29214): Terminated: ok {rc=0} 10:31:24.437700 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29211): Process ended prematurely: osmo-stp_10.42.42.5(pid=29211) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29211)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 10:31:24.447158 tst ping.py:22: Test FAILED (6.6 sec) 10:31:24.476038 run osmo-hlr_10.42.42.2(pid=29208): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29208)] 10:31:24.526708 run osmo-hlr_10.42.42.2(pid=29208): stdout: | (launched: 2022-12-10_10:31:21.173202) 10:31:24.579069 run osmo-hlr_10.42.42.2(pid=29208): stderr: | 20221210103121369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103121369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103121369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103121369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103121369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103121369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103121382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103121390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103121390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103121390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:24.631837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29207): Terminating (SIGTERM) 10:31:24.674183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29210): Terminating (SIGTERM) 10:31:24.717016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29213): Terminating (SIGTERM) 10:31:24.759643 --- ParallelTerminationStrategy: PID 29207 died... 10:31:24.779776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29207): Terminated: ok {rc=0} 10:31:24.827126 --- ParallelTerminationStrategy: PID 29210 died... 10:31:24.846867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29210): Terminated: ok {rc=0} 10:31:24.893811 --- ParallelTerminationStrategy: PID 29213 died... 10:31:24.913566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29213): Terminated: ok {rc=0} 10:31:25.001833 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:31:26.090098 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.102144 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:31:26.179374 tst ping_idle_ping.py: using LAC 27775 10:31:26.305073 tst ping_idle_ping.py: using RAC 235 10:31:26.428634 tst ping_idle_ping.py: using CellId 27775 10:31:26.552202 tst ping_idle_ping.py: using BVCI 27776 10:31:26.661797 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.672670 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.683513 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.694858 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.706045 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.717520 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.728828 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:31:26.740116 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:31:26.853902 tst ping_idle_ping.py:24: start network... 10:31:27.052585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:27.512106 run create_hlr_db(pid=29215): Launched 10:31:27.634390 bus /gobi_6: Setting Powered False 10:31:28.694072 run create_hlr_db(pid=29215): Terminated: ok {rc=0} 10:31:29.128099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29217): Launched 10:31:29.445429 run osmo-hlr_10.42.42.2(pid=29218): Launched 10:31:29.567823 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:30.111639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29220): Launched 10:31:30.429761 run osmo-stp_10.42.42.5(pid=29221): Launched 10:31:30.550758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:31.129758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29223): Launched 10:31:31.255029 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:31.519813 run patchelf(pid=29224): Launched 10:31:31.692279 run osmo-stp_10.42.42.5(pid=29221): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29221)] 10:31:31.844519 run osmo-stp_10.42.42.5(pid=29221): stdout: | (launched: 2022-12-10_10:31:30.372251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:31.980523 run osmo-stp_10.42.42.5(pid=29221): stderr: | 20221210103130562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103130563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103130563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103130563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103130565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103130566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103130566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:32.112996 run osmo-stp_10.42.42.5(pid=29221): stdout: | (launched: 2022-12-10_10:31:30.372251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:32.237745 run osmo-stp_10.42.42.5(pid=29221): stderr: | 20221210103130562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103130563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103130563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103130563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103130565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103130566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103130566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:32.382955 run patchelf(pid=29224): Terminating (SIGINT) 10:31:32.551120 run patchelf(pid=29224): Terminated: ok {rc=0} 10:31:32.672036 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29221): Process ended prematurely: osmo-stp_10.42.42.5(pid=29221) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29221)] [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:31:32.680918 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:31:32.707952 run osmo-hlr_10.42.42.2(pid=29218): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29218)] 10:31:32.756279 run osmo-hlr_10.42.42.2(pid=29218): stdout: | (launched: 2022-12-10_10:31:29.388334) 10:31:32.805861 run osmo-hlr_10.42.42.2(pid=29218): stderr: | 20221210103129584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103129584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103129584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103129584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103129584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103129584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103129597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103129605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103129605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103129605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:32.855689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29217): Terminating (SIGTERM) 10:31:32.895431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29220): Terminating (SIGTERM) 10:31:32.935074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29223): Terminating (SIGTERM) 10:31:32.975134 --- ParallelTerminationStrategy: PID 29217 died... 10:31:32.994338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29217): Terminated: ok {rc=0} 10:31:33.038406 --- ParallelTerminationStrategy: PID 29220 died... 10:31:33.057300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29220): Terminated: ok {rc=0} 10:31:33.101457 --- ParallelTerminationStrategy: PID 29223 died... 10:31:33.120125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29223): Terminated: ok {rc=0} 10:31:33.206466 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:31:34.510790 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:31:34.518956 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:31:34.553105 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 10:31:34.593300 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 10:31:34.682980 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:31:34.716802 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 10:31:34.756520 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 10:31:35.364359 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 10:31:35.415563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:35.426919 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:31:35.479713 tst cs_paging_gprs_active.py: using LAC 27776 10:31:35.599500 tst cs_paging_gprs_active.py: using RAC 236 10:31:35.727664 tst cs_paging_gprs_active.py: using CellId 27776 10:31:35.855225 tst cs_paging_gprs_active.py: using BVCI 27777 10:31:35.972670 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:35.984347 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:35.995893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:36.007691 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:36.019358 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:36.031188 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:36.043014 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:36.054663 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:36.066680 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:36.182892 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:36.297495 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:31:36.500529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:36.803092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29228): Launched 10:31:37.066891 run iperf3-srv_10.42.42.10(pid=29229): Launched 10:31:37.180473 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:31:37.383181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:37.687127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29230): Launched 10:31:37.951198 run iperf3-srv_10.42.42.10(pid=29231): Launched 10:31:38.064413 tst cs_paging_gprs_active.py:38: start network... 10:31:38.266460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:38.735284 run create_hlr_db(pid=29232): Launched 10:31:38.859944 bus /gobi_6: Setting Powered False 10:31:39.924544 run create_hlr_db(pid=29232): Terminated: ok {rc=0} 10:31:40.358586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29234): Launched 10:31:40.662515 run osmo-hlr_10.42.42.2(pid=29235): Launched 10:31:40.779124 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:41.301461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29237): Launched 10:31:41.604275 run osmo-stp_10.42.42.5(pid=29238): Launched 10:31:41.721062 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:42.242915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29240): Launched 10:31:42.358290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:42.613091 run patchelf(pid=29241): Launched 10:31:42.781997 run osmo-stp_10.42.42.5(pid=29238): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29238)] 10:31:42.910396 run osmo-stp_10.42.42.5(pid=29238): stdout: | (launched: 2022-12-10_10:31:41.548547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:43.040027 run osmo-stp_10.42.42.5(pid=29238): stderr: | 20221210103141721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103141721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103141721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103141721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103141722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103141722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103141722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:43.169804 run osmo-stp_10.42.42.5(pid=29238): stdout: | (launched: 2022-12-10_10:31:41.548547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:43.293715 run osmo-stp_10.42.42.5(pid=29238): stderr: | 20221210103141721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103141721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103141721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103141721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103141722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103141722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103141722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:43.440384 run patchelf(pid=29241): Terminating (SIGINT) 10:31:43.611104 run patchelf(pid=29241): Terminated: ok {rc=0} 10:31:43.733708 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29238): Process ended prematurely: osmo-stp_10.42.42.5(pid=29238) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29238)] [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 10:31:43.743033 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 10:31:43.769960 run osmo-hlr_10.42.42.2(pid=29235): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29235)] 10:31:43.817281 run osmo-hlr_10.42.42.2(pid=29235): stdout: | (launched: 2022-12-10_10:31:40.606942) 10:31:43.866252 run osmo-hlr_10.42.42.2(pid=29235): stderr: | 20221210103140787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103140787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103140787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103140787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103140787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103140787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103140799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103140808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103140808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103140808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:43.915655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29228): Terminating (SIGTERM) 10:31:43.955176 run iperf3-srv_10.42.42.10(pid=29229): Terminating (SIGTERM) 10:31:43.994575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29230): Terminating (SIGTERM) 10:31:44.034036 run iperf3-srv_10.42.42.10(pid=29231): Terminating (SIGTERM) 10:31:44.073247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29234): Terminating (SIGTERM) 10:31:44.112637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29237): Terminating (SIGTERM) 10:31:44.151878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29240): Terminating (SIGTERM) 10:31:44.191349 --- ParallelTerminationStrategy: PID 29228 died... 10:31:44.210090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29228): Terminated: ok {rc=0} 10:31:44.253837 --- ParallelTerminationStrategy: PID 29229 died... 10:31:44.272112 run iperf3-srv_10.42.42.10(pid=29229): Terminated {rc=256} 10:31:44.315856 --- ParallelTerminationStrategy: PID 29230 died... 10:31:44.334222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29230): Terminated: ok {rc=0} 10:31:44.378052 --- ParallelTerminationStrategy: PID 29231 died... 10:31:44.396402 run iperf3-srv_10.42.42.10(pid=29231): Terminated {rc=256} 10:31:44.440176 --- ParallelTerminationStrategy: PID 29234 died... 10:31:44.458592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29234): Terminated: ok {rc=0} 10:31:44.501945 --- ParallelTerminationStrategy: PID 29237 died... 10:31:44.520204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29237): Terminated: ok {rc=0} 10:31:44.563905 --- ParallelTerminationStrategy: PID 29240 died... 10:31:44.582362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29240): Terminated: ok {rc=0} 10:31:44.667559 bus /gobi_0: Setting Powered False 10:31:45.766551 bus /gobi_0: Setting Powered False 10:31:46.883053 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 10:31:48.025643 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.037527 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:31:48.092020 tst iperf3.py: using LAC 27777 10:31:48.212170 tst iperf3.py: using RAC 237 10:31:48.331976 tst iperf3.py: using CellId 27777 10:31:48.459883 tst iperf3.py: using BVCI 27778 10:31:48.577300 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.589224 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.600710 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.612502 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.624339 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.636125 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.647993 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.659676 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:48.671516 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:48.786895 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:31:48.989895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:49.292434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29242): Launched 10:31:49.556423 run iperf3-srv_10.42.42.10(pid=29243): Launched 10:31:49.670838 tst iperf3.py:8: start network... 10:31:49.872769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:31:50.340368 run create_hlr_db(pid=29244): Launched 10:31:50.463712 bus /gobi_6: Setting Powered False 10:31:51.524431 run create_hlr_db(pid=29244): Terminated: ok {rc=0} 10:31:51.963878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29246): Launched 10:31:52.284913 run osmo-hlr_10.42.42.2(pid=29247): Launched 10:31:52.408481 run osmo-stp_10.42.42.5: Starting osmo-stp 10:31:52.965664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29249): Launched 10:31:53.288197 run osmo-stp_10.42.42.5(pid=29250): Launched 10:31:53.411267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:31:53.966693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29252): Launched 10:31:54.091718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:31:54.364183 run patchelf(pid=29253): Launched 10:31:54.544040 run osmo-stp_10.42.42.5(pid=29250): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29250)] 10:31:54.681153 run osmo-stp_10.42.42.5(pid=29250): stdout: | (launched: 2022-12-10_10:31:53.230158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:54.819783 run osmo-stp_10.42.42.5(pid=29250): stderr: | 20221210103153422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103153423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103153423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103153423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103153424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103153424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103153424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:54.958485 run osmo-stp_10.42.42.5(pid=29250): stdout: | (launched: 2022-12-10_10:31:53.230158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:31:55.090752 run osmo-stp_10.42.42.5(pid=29250): stderr: | 20221210103153422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103153423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103153423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103153423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103153424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103153424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103153424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:31:55.247562 run patchelf(pid=29253): Terminating (SIGINT) 10:31:55.429489 run patchelf(pid=29253): Terminated: ok {rc=0} 10:31:55.560485 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29250): Process ended prematurely: osmo-stp_10.42.42.5(pid=29250) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29250)] [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 10:31:55.570708 tst iperf3.py:8: Test FAILED (7.6 sec) 10:31:55.599959 run osmo-hlr_10.42.42.2(pid=29247): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29247)] 10:31:55.650443 run osmo-hlr_10.42.42.2(pid=29247): stdout: | (launched: 2022-12-10_10:31:52.227190) 10:31:55.702468 run osmo-hlr_10.42.42.2(pid=29247): stderr: | 20221210103152423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103152423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103152423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103152423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103152423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103152423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103152435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103152443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103152443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103152443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:31:55.755087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29242): Terminating (SIGTERM) 10:31:55.797454 run iperf3-srv_10.42.42.10(pid=29243): Terminating (SIGTERM) 10:31:55.839465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29246): Terminating (SIGTERM) 10:31:55.881744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29249): Terminating (SIGTERM) 10:31:55.923946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29252): Terminating (SIGTERM) 10:31:55.966323 --- ParallelTerminationStrategy: PID 29242 died... 10:31:55.986287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29242): Terminated: ok {rc=0} 10:31:56.032818 --- ParallelTerminationStrategy: PID 29243 died... 10:31:56.052225 run iperf3-srv_10.42.42.10(pid=29243): Terminated {rc=256} 10:31:56.098441 --- ParallelTerminationStrategy: PID 29246 died... 10:31:56.117838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29246): Terminated: ok {rc=0} 10:31:56.164108 --- ParallelTerminationStrategy: PID 29249 died... 10:31:56.183487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29249): Terminated: ok {rc=0} 10:31:56.229556 --- ParallelTerminationStrategy: PID 29252 died... 10:31:56.249036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29252): Terminated: ok {rc=0} 10:31:56.337830 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 10:31:57.489594 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:57.502077 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:31:57.556507 tst iperf3m4.py: using LAC 27778 10:31:57.683330 tst iperf3m4.py: using RAC 238 10:31:57.810677 tst iperf3m4.py: using CellId 27778 10:31:57.936254 tst iperf3m4.py: using BVCI 27779 10:31:58.053851 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.065635 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.077196 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.089604 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.101971 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.115108 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.127674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.139181 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:31:58.151645 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:58.273558 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:58.393614 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:58.513766 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:31:58.630639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:31:58.833134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:31:59.135999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29254): Launched 10:31:59.399532 run iperf3-srv_10.42.42.10(pid=29255): Launched 10:31:59.513321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:31:59.714982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:00.017517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Launched 10:32:00.281596 run iperf3-srv_10.42.42.10(pid=29257): Launched 10:32:00.395249 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:32:00.596621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:00.917642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29258): Launched 10:32:01.268326 run iperf3-srv_10.42.42.10(pid=29259): Launched 10:32:01.398221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:32:01.603732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:32:01.925704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29260): Launched 10:32:02.209826 run iperf3-srv_10.42.42.10(pid=29261): Launched 10:32:02.343118 tst iperf3m4.py:8: start network... 10:32:02.560892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:03.064230 run create_hlr_db(pid=29262): Launched 10:32:03.187525 bus /gobi_6: Setting Powered False 10:32:04.251481 run create_hlr_db(pid=29262): Terminated: ok {rc=0} 10:32:04.700716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29264): Launched 10:32:05.022315 run osmo-hlr_10.42.42.2(pid=29265): Launched 10:32:05.145967 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:05.703329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29267): Launched 10:32:06.024844 run osmo-stp_10.42.42.5(pid=29268): Launched 10:32:06.149320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:06.709327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29270): Launched 10:32:06.833544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:07.105144 run patchelf(pid=29271): Launched 10:32:07.284609 run osmo-stp_10.42.42.5(pid=29268): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29268)] 10:32:07.422416 run osmo-stp_10.42.42.5(pid=29268): stdout: | (launched: 2022-12-10_10:32:05.966964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:07.561516 run osmo-stp_10.42.42.5(pid=29268): stderr: | 20221210103206157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103206158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103206158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103206158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103206161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103206161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103206161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:07.700000 run osmo-stp_10.42.42.5(pid=29268): stdout: | (launched: 2022-12-10_10:32:05.966964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:07.832857 run osmo-stp_10.42.42.5(pid=29268): stderr: | 20221210103206157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103206158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103206158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103206158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103206161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103206161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103206161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:07.989819 run patchelf(pid=29271): Terminating (SIGINT) 10:32:08.170646 run patchelf(pid=29271): Terminated: ok {rc=0} 10:32:08.301430 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29268): Process ended prematurely: osmo-stp_10.42.42.5(pid=29268) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29268)] [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 10:32:08.311930 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:32:08.341605 run osmo-hlr_10.42.42.2(pid=29265): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29265)] 10:32:08.392117 run osmo-hlr_10.42.42.2(pid=29265): stdout: | (launched: 2022-12-10_10:32:04.964086) 10:32:08.444232 run osmo-hlr_10.42.42.2(pid=29265): stderr: | 20221210103205160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103205160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103205160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103205160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103205161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103205161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103205173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103205181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103205182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103205182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:08.496643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29254): Terminating (SIGTERM) 10:32:08.538989 run iperf3-srv_10.42.42.10(pid=29255): Terminating (SIGTERM) 10:32:08.581233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Terminating (SIGTERM) 10:32:08.623224 run iperf3-srv_10.42.42.10(pid=29257): Terminating (SIGTERM) 10:32:08.665297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29258): Terminating (SIGTERM) 10:32:08.707424 run iperf3-srv_10.42.42.10(pid=29259): Terminating (SIGTERM) 10:32:08.749285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29260): Terminating (SIGTERM) 10:32:08.791285 run iperf3-srv_10.42.42.10(pid=29261): Terminating (SIGTERM) 10:32:08.833634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29264): Terminating (SIGTERM) 10:32:08.875772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29267): Terminating (SIGTERM) 10:32:08.917695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29270): Terminating (SIGTERM) 10:32:08.959831 --- ParallelTerminationStrategy: PID 29254 died... 10:32:08.979518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29254): Terminated: ok {rc=0} 10:32:09.026792 --- ParallelTerminationStrategy: PID 29255 died... 10:32:09.046291 run iperf3-srv_10.42.42.10(pid=29255): Terminated {rc=256} 10:32:09.092928 --- ParallelTerminationStrategy: PID 29256 died... 10:32:09.112826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Terminated: ok {rc=0} 10:32:09.159135 --- ParallelTerminationStrategy: PID 29257 died... 10:32:09.178480 run iperf3-srv_10.42.42.10(pid=29257): Terminated {rc=256} 10:32:09.224713 --- ParallelTerminationStrategy: PID 29258 died... 10:32:09.244178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29258): Terminated: ok {rc=0} 10:32:09.290595 --- ParallelTerminationStrategy: PID 29259 died... 10:32:09.309937 run iperf3-srv_10.42.42.10(pid=29259): Terminated {rc=256} 10:32:09.356595 --- ParallelTerminationStrategy: PID 29260 died... 10:32:09.376085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29260): Terminated: ok {rc=0} 10:32:09.422579 --- ParallelTerminationStrategy: PID 29261 died... 10:32:09.441939 run iperf3-srv_10.42.42.10(pid=29261): Terminated {rc=256} 10:32:09.488320 --- ParallelTerminationStrategy: PID 29264 died... 10:32:09.507855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29264): Terminated: ok {rc=0} 10:32:09.554492 --- ParallelTerminationStrategy: PID 29267 died... 10:32:09.573970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29267): Terminated: ok {rc=0} 10:32:09.620560 --- ParallelTerminationStrategy: PID 29270 died... 10:32:09.640183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29270): Terminated: ok {rc=0} 10:32:09.728356 bus /gobi_4: Setting Powered False 10:32:10.827467 bus /gobi_4: Setting Powered False 10:32:11.944918 bus /gobi_1: Setting Powered False 10:32:13.042047 bus /gobi_1: Setting Powered False 10:32:14.158300 bus /gobi_0: Setting Powered False 10:32:15.255220 bus /gobi_0: Setting Powered False 10:32:16.367343 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 10:32:17.467772 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:17.479822 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:32:17.532176 tst ping.py: using LAC 27779 10:32:17.650574 tst ping.py: using RAC 239 10:32:17.768909 tst ping.py: using CellId 27779 10:32:17.887124 tst ping.py: using BVCI 27780 10:32:17.996479 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:18.007961 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:18.019291 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:18.030613 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:18.041799 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:18.053160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:18.064570 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:18.075675 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:18.189069 tst ping.py:19: start network... 10:32:18.388449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:18.845980 run create_hlr_db(pid=29272): Launched 10:32:18.966907 bus /gobi_6: Setting Powered False 10:32:20.026851 run create_hlr_db(pid=29272): Terminated: ok {rc=0} 10:32:20.440733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29274): Launched 10:32:20.736856 run osmo-hlr_10.42.42.2(pid=29275): Launched 10:32:20.850662 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:21.364388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29277): Launched 10:32:21.661321 run osmo-stp_10.42.42.5(pid=29278): Launched 10:32:21.774407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:22.287404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29280): Launched 10:32:22.401734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:22.651853 run patchelf(pid=29281): Launched 10:32:22.817289 run osmo-stp_10.42.42.5(pid=29278): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29278)] 10:32:22.943087 run osmo-stp_10.42.42.5(pid=29278): stdout: | (launched: 2022-12-10_10:32:21.607372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:23.070556 run osmo-stp_10.42.42.5(pid=29278): stderr: | 20221210103221778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103221778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103221778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103221779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103221781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103221781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103221781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:23.198004 run osmo-stp_10.42.42.5(pid=29278): stdout: | (launched: 2022-12-10_10:32:21.607372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:23.319419 run osmo-stp_10.42.42.5(pid=29278): stderr: | 20221210103221778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103221778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103221778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103221779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103221781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103221781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103221781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:23.463872 run patchelf(pid=29281): Terminating (SIGINT) 10:32:23.630140 run patchelf(pid=29281): Terminated: ok {rc=0} 10:32:23.750336 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29278): Process ended prematurely: osmo-stp_10.42.42.5(pid=29278) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29278)] [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 10:32:23.759157 tst ping.py:22: Test FAILED (6.3 sec) 10:32:23.785737 run osmo-hlr_10.42.42.2(pid=29275): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29275)] 10:32:23.833052 run osmo-hlr_10.42.42.2(pid=29275): stdout: | (launched: 2022-12-10_10:32:20.682427) 10:32:23.881761 run osmo-hlr_10.42.42.2(pid=29275): stderr: | 20221210103220859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103220859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103220859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103220859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103220859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103220859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103220871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103220880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103220880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103220880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:23.931207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29274): Terminating (SIGTERM) 10:32:23.970799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29277): Terminating (SIGTERM) 10:32:24.010217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29280): Terminating (SIGTERM) 10:32:24.049651 --- ParallelTerminationStrategy: PID 29274 died... 10:32:24.068629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29274): Terminated: ok {rc=0} 10:32:24.112509 --- ParallelTerminationStrategy: PID 29277 died... 10:32:24.130947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29277): Terminated: ok {rc=0} 10:32:24.174445 --- ParallelTerminationStrategy: PID 29280 died... 10:32:24.193110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29280): Terminated: ok {rc=0} 10:32:24.275923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 10:32:25.361591 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.373988 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:32:25.430768 tst ping_idle_ping.py: using LAC 27780 10:32:25.554926 tst ping_idle_ping.py: using RAC 240 10:32:25.677382 tst ping_idle_ping.py: using CellId 27780 10:32:25.799536 tst ping_idle_ping.py: using BVCI 27781 10:32:25.909490 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.920853 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.932645 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.944578 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.957589 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.969460 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.981116 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 10:32:25.992597 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 10:32:26.107215 tst ping_idle_ping.py:24: start network... 10:32:26.307873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:26.771194 run create_hlr_db(pid=29282): Launched 10:32:26.893082 bus /gobi_6: Setting Powered False 10:32:27.953917 run create_hlr_db(pid=29282): Terminated: ok {rc=0} 10:32:28.388791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29284): Launched 10:32:28.706352 run osmo-hlr_10.42.42.2(pid=29285): Launched 10:32:28.822977 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:29.339219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29287): Launched 10:32:29.638124 run osmo-stp_10.42.42.5(pid=29288): Launched 10:32:29.752538 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:30.265061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29290): Launched 10:32:30.379628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:30.630703 run patchelf(pid=29291): Launched 10:32:30.796863 run osmo-stp_10.42.42.5(pid=29288): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29288)] 10:32:30.960132 run osmo-stp_10.42.42.5(pid=29288): stdout: | (launched: 2022-12-10_10:32:29.584066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:31.100187 run osmo-stp_10.42.42.5(pid=29288): stderr: | 20221210103229754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103229755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103229755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103229755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103229756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103229756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103229756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:31.241877 run osmo-stp_10.42.42.5(pid=29288): stdout: | (launched: 2022-12-10_10:32:29.584066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:31.377486 run osmo-stp_10.42.42.5(pid=29288): stderr: | 20221210103229754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103229755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103229755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103229755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103229756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103229756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103229756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:31.536331 run patchelf(pid=29291): Terminating (SIGINT) 10:32:31.722304 run patchelf(pid=29291): Terminated: ok {rc=0} 10:32:31.855231 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29288): Process ended prematurely: osmo-stp_10.42.42.5(pid=29288) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29288)] [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 10:32:31.866003 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:32:31.898547 run osmo-hlr_10.42.42.2(pid=29285): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29285)] 10:32:31.952300 run osmo-hlr_10.42.42.2(pid=29285): stdout: | (launched: 2022-12-10_10:32:28.648840) 10:32:32.006849 run osmo-hlr_10.42.42.2(pid=29285): stderr: | 20221210103228823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103228823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103228823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103228823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103228823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103228823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103228835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103228843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103228843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103228843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:32.062217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29284): Terminating (SIGTERM) 10:32:32.106737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29287): Terminating (SIGTERM) 10:32:32.153353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29290): Terminating (SIGTERM) 10:32:32.196546 --- ParallelTerminationStrategy: PID 29284 died... 10:32:32.216629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29284): Terminated: ok {rc=0} 10:32:32.263362 --- ParallelTerminationStrategy: PID 29287 died... 10:32:32.282745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29287): Terminated: ok {rc=0} 10:32:32.329663 --- ParallelTerminationStrategy: PID 29290 died... 10:32:32.350268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29290): Terminated: ok {rc=0} 10:32:32.439440 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:32:33.752382 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:32:33.759553 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:32:33.793642 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:32:33.829172 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:32:33.883394 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:32:33.916873 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:32:33.952248 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:32:34.518761 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:32:34.524164 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:34.535781 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:32:34.606266 tst switch_tch_pdch.py: using LAC 27781 10:32:34.731795 tst switch_tch_pdch.py: using RAC 241 10:32:34.855014 tst switch_tch_pdch.py: using CellId 27781 10:32:34.980755 tst switch_tch_pdch.py: using BVCI 27782 10:32:35.096190 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:35.107781 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:35.119175 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:35.130904 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:35.142697 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:35.154369 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:35.166133 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:32:35.177816 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:32:35.293711 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:32:35.408091 tst switch_tch_pdch.py:51: start network... 10:32:35.605451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:36.066798 run create_hlr_db(pid=29298): Launched 10:32:36.188838 bus /gobi_6: Setting Powered False 10:32:37.248932 run create_hlr_db(pid=29298): Terminated: ok {rc=0} 10:32:37.681987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Launched 10:32:37.998023 run osmo-hlr_10.42.42.2(pid=29301): Launched 10:32:38.118982 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:38.666768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Launched 10:32:38.984228 run osmo-stp_10.42.42.5(pid=29304): Launched 10:32:39.105764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:39.650406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29306): Launched 10:32:39.771619 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:40.037733 run patchelf(pid=29307): Launched 10:32:40.214323 run osmo-stp_10.42.42.5(pid=29304): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] 10:32:40.349066 run osmo-stp_10.42.42.5(pid=29304): stdout: | (launched: 2022-12-10_10:32:38.927128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:40.486088 run osmo-stp_10.42.42.5(pid=29304): stderr: | 20221210103239116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103239116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103239116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103239117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103239117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103239117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103239118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:40.622597 run osmo-stp_10.42.42.5(pid=29304): stdout: | (launched: 2022-12-10_10:32:38.927128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:40.752411 run osmo-stp_10.42.42.5(pid=29304): stderr: | 20221210103239116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103239116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103239116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103239117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103239117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103239117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103239118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:40.906438 run patchelf(pid=29307): Terminating (SIGINT) 10:32:41.084172 run patchelf(pid=29307): Terminated: ok {rc=0} 10:32:41.212484 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29304): Process ended prematurely: osmo-stp_10.42.42.5(pid=29304) [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:32:41.222029 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:32:41.250419 run osmo-hlr_10.42.42.2(pid=29301): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29301)] 10:32:41.300860 run osmo-hlr_10.42.42.2(pid=29301): stdout: | (launched: 2022-12-10_10:32:37.940638) 10:32:41.353177 run osmo-hlr_10.42.42.2(pid=29301): stderr: | 20221210103238135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103238135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103238136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103238136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103238136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103238136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103238148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103238157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103238158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103238158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:41.406150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Terminating (SIGTERM) 10:32:41.448349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Terminating (SIGTERM) 10:32:41.490553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29306): Terminating (SIGTERM) 10:32:41.532805 --- ParallelTerminationStrategy: PID 29300 died... 10:32:41.552749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Terminated: ok {rc=0} 10:32:41.599636 --- ParallelTerminationStrategy: PID 29303 died... 10:32:41.619171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Terminated: ok {rc=0} 10:32:41.665749 --- ParallelTerminationStrategy: PID 29306 died... 10:32:41.685246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29306): Terminated: ok {rc=0} 10:32:41.773386 bus /gobi_0: Setting Powered False 10:32:42.873847 bus /gobi_0: Setting Powered False 10:32:43.990358 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:32:45.244221 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:32:45.250572 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:32:45.285082 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:32:45.320619 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:32:45.375506 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:32:45.408720 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:32:45.444086 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:32:46.008448 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:32:46.014473 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.026906 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:32:46.100065 tst switch_tch_pdch.py: using LAC 27782 10:32:46.224703 tst switch_tch_pdch.py: using RAC 242 10:32:46.350508 tst switch_tch_pdch.py: using CellId 27782 10:32:46.470152 tst switch_tch_pdch.py: using BVCI 27783 10:32:46.589331 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.601942 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.615530 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.628876 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.641217 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.655485 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.667931 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:32:46.681279 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:32:46.818831 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:32:46.938652 tst switch_tch_pdch.py:51: start network... 10:32:47.158220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:32:47.622875 run create_hlr_db(pid=29311): Launched 10:32:47.743296 bus /gobi_6: Setting Powered False 10:32:48.806261 run create_hlr_db(pid=29311): Terminated: ok {rc=0} 10:32:49.206975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29313): Launched 10:32:49.503521 run osmo-hlr_10.42.42.2(pid=29314): Launched 10:32:49.618140 run osmo-stp_10.42.42.5: Starting osmo-stp 10:32:50.121486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29316): Launched 10:32:50.417349 run osmo-stp_10.42.42.5(pid=29317): Launched 10:32:50.530203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:32:51.016466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29319): Launched 10:32:51.130050 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:32:51.379357 run patchelf(pid=29320): Launched 10:32:51.543650 run osmo-stp_10.42.42.5(pid=29317): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29317)] 10:32:51.668702 run osmo-stp_10.42.42.5(pid=29317): stdout: | (launched: 2022-12-10_10:32:50.363699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:51.795551 run osmo-stp_10.42.42.5(pid=29317): stderr: | 20221210103250530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103250530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103250531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103250531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103250533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103250533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103250533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:51.922502 run osmo-stp_10.42.42.5(pid=29317): stdout: | (launched: 2022-12-10_10:32:50.363699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:32:52.043398 run osmo-stp_10.42.42.5(pid=29317): stderr: | 20221210103250530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103250530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103250531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103250531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103250533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103250533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103250533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:32:52.187539 run patchelf(pid=29320): Terminating (SIGINT) 10:32:52.353473 run patchelf(pid=29320): Terminated: ok {rc=0} 10:32:52.473153 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29317): Process ended prematurely: osmo-stp_10.42.42.5(pid=29317) [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29317)] [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:32:52.481917 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 10:32:52.508244 run osmo-hlr_10.42.42.2(pid=29314): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29314)] 10:32:52.555547 run osmo-hlr_10.42.42.2(pid=29314): stdout: | (launched: 2022-12-10_10:32:49.449761) 10:32:52.604515 run osmo-hlr_10.42.42.2(pid=29314): stderr: | 20221210103249624 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103249625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103249625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103249625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103249625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103249625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103249636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103249645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103249645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103249645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:32:52.654026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29313): Terminating (SIGTERM) 10:32:52.693705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29316): Terminating (SIGTERM) 10:32:52.733214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29319): Terminating (SIGTERM) 10:32:52.772844 --- ParallelTerminationStrategy: PID 29313 died... 10:32:52.791823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29313): Terminated: ok {rc=0} 10:32:52.835258 --- ParallelTerminationStrategy: PID 29316 died... 10:32:52.853595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29316): Terminated: ok {rc=0} 10:32:52.897428 --- ParallelTerminationStrategy: PID 29319 died... 10:32:52.915822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29319): Terminated: ok {rc=0} 10:32:53.001603 bus /gobi_0: Setting Powered False 10:32:54.101596 bus /gobi_0: Setting Powered False 10:32:55.217224 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_sms:trx-lms --------------------------------------------------------------------- 10:32:56.471019 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:32:56.475442 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:32:56.509045 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:32:56.515644 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:32:56.566703 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:32:56.599252 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:32:56.605869 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:32:57.145337 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:32:57.150216 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 10:32:57.161245 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 10:32:57.208269 tst mo_mt_sms.py: using LAC 27783 10:32:57.327685 tst mo_mt_sms.py: using RAC 243 10:32:57.443475 tst mo_mt_sms.py: using CellId 27783 10:32:57.557509 tst mo_mt_sms.py: using BVCI 27784 10:32:57.664266 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:32:57.780161 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 10:32:57.897273 tst mo_mt_sms.py:9: start nitb and bts... 10:32:58.112321 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:32:58.756017 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29324): Launched 10:32:59.071719 run osmo-nitb_10.42.42.2(pid=29325): Launched 10:32:59.247362 run osmo-nitb_10.42.42.2(pid=29325): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29325)] 10:32:59.390140 run osmo-nitb_10.42.42.2(pid=29325): stdout: | (launched: 2022-12-10_10:32:59.014745) 10:32:59.533958 run osmo-nitb_10.42.42.2(pid=29325): stderr: | (launched: 2022-12-10_10:32:59.061728) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:32:59.677309 run osmo-nitb_10.42.42.2(pid=29325): stdout: | (launched: 2022-12-10_10:32:59.014745) 10:32:59.815118 run osmo-nitb_10.42.42.2(pid=29325): stderr: | (launched: 2022-12-10_10:32:59.061728) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29325): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29325) [trial-2373↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29325)] 10:33:00.191228 tst osmo-nitb_10.42.42.2(pid=29325): stdout: | (launched: 2022-12-10_10:32:59.014745) 10:33:00.320264 tst osmo-nitb_10.42.42.2(pid=29325): stderr: | (launched: 2022-12-10_10:32:59.061728) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:33:00.471733 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29325): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29325) [trial-2373↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29325)] [trial-2373↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 10:33:00.480709 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:33:00.487961 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29324): Terminating (SIGTERM) 10:33:00.700411 --- ParallelTerminationStrategy: PID 29324 died... 10:33:00.721772 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29324): Terminated: ok {rc=0} 10:33:00.811103 bus /sierra_3: Setting Powered False 10:33:01.913891 bus /sierra_3: Setting Powered False 10:33:03.031757 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:trx-lms --------------------------------------------------------------------- 10:33:04.229854 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:04.234504 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 10:33:04.267520 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:33:04.294264 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 10:33:04.345123 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 10:33:04.377470 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:33:04.403731 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 10:33:04.951240 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 10:33:04.956040 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:04.966592 tst sms:trx-lms: Using 1 x bts (candidates: 1) 10:33:05.014258 tst mo_mt_sms.py: using LAC 27784 10:33:05.131379 tst mo_mt_sms.py: using RAC 244 10:33:05.247720 tst mo_mt_sms.py: using CellId 27784 10:33:05.365518 tst mo_mt_sms.py: using BVCI 27785 10:33:05.474334 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:05.484838 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:05.495301 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:05.505745 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:05.516070 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:05.526488 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:33:05.640313 tst sms:trx-lms: Using 1 x modem (candidates: 2) 10:33:05.759807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:06.250664 run create_hlr_db(pid=29330): Launched 10:33:06.372314 bus /sierra_2: Setting Powered False 10:33:07.436160 run create_hlr_db(pid=29330): Terminated: ok {rc=0} 10:33:07.875909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Launched 10:33:08.190148 run osmo-hlr_10.42.42.2(pid=29333): Launched 10:33:08.310861 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:08.856240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Launched 10:33:09.170952 run osmo-stp_10.42.42.5(pid=29336): Launched 10:33:09.291699 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:09.864741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29338): Launched 10:33:10.181027 run osmo-msc_10.42.42.6(pid=29339): Launched 10:33:10.358546 run osmo-stp_10.42.42.5(pid=29336): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] 10:33:10.492620 run osmo-stp_10.42.42.5(pid=29336): stdout: | (launched: 2022-12-10_10:33:09.114159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:10.627289 run osmo-stp_10.42.42.5(pid=29336): stderr: | 20221210103309303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103309303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103309304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103309304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103309304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103309305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103309305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:10.760909 run osmo-stp_10.42.42.5(pid=29336): stdout: | (launched: 2022-12-10_10:33:09.114159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:10.887025 run osmo-stp_10.42.42.5(pid=29336): stderr: | 20221210103309303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103309303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103309304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103309304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103309304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103309305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103309305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:11.037772 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29336): Process ended prematurely: osmo-stp_10.42.42.5(pid=29336) [trial-2373↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] [trial-2373↪sms:trx-lms↪mo_mt_sms.py:16] 10:33:11.046531 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 10:33:11.074041 run osmo-hlr_10.42.42.2(pid=29333): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29333)] 10:33:11.124533 run osmo-hlr_10.42.42.2(pid=29333): stdout: | (launched: 2022-12-10_10:33:08.133291) 10:33:11.176282 run osmo-hlr_10.42.42.2(pid=29333): stderr: | 20221210103308328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103308328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103308328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103308328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103308328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103308328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103308341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103308350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103308350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103308350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:11.248172 run osmo-msc_10.42.42.6(pid=29339): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29339)] 10:33:11.297916 run osmo-msc_10.42.42.6(pid=29339): stdout: | (launched: 2022-12-10_10:33:10.123593) 10:33:11.349665 run osmo-msc_10.42.42.6(pid=29339): stderr: | 20221210103310443 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103310443 DLGLOBAL DEBUG validating counter group 0x7f985ca20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103310443 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103310443 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103310443 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103310444 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103310445 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103310446 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103310446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103310446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:11.402206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Terminating (SIGTERM) 10:33:11.444211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Terminating (SIGTERM) 10:33:11.485944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29338): Terminating (SIGTERM) 10:33:11.527912 --- ParallelTerminationStrategy: PID 29332 died... 10:33:11.547740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Terminated: ok {rc=0} 10:33:11.594099 --- ParallelTerminationStrategy: PID 29335 died... 10:33:11.613449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Terminated: ok {rc=0} 10:33:11.659632 --- ParallelTerminationStrategy: PID 29338 died... 10:33:11.679014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29338): Terminated: ok {rc=0} 10:33:11.766872 bus /sierra_3: Setting Powered False 10:33:12.865634 bus /sierra_3: Setting Powered False 10:33:13.984196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-lms --------------------------------------------------------------------- 10:33:15.209914 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:15.213947 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:33:15.247227 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 10:33:15.254038 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:33:15.287429 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:33:15.320173 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 10:33:15.326799 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:33:15.858558 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 10:33:15.864743 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 10:33:15.877236 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 10:33:15.938588 tst assert_extension.py: using LAC 27785 10:33:16.064801 tst assert_extension.py: using RAC 245 10:33:16.191861 tst assert_extension.py: using CellId 27785 10:33:16.350702 tst assert_extension.py: using BVCI 27786 10:33:16.471582 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 10:33:16.622775 tst assert_extension.py:10: start nitb and bts... 10:33:16.832051 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:33:17.446872 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29344): Launched 10:33:17.742575 run osmo-nitb_10.42.42.2(pid=29345): Launched 10:33:17.907116 run osmo-nitb_10.42.42.2(pid=29345): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29345)] 10:33:18.039952 run osmo-nitb_10.42.42.2(pid=29345): stdout: | (launched: 2022-12-10_10:33:17.688925) 10:33:18.174325 run osmo-nitb_10.42.42.2(pid=29345): stderr: | (launched: 2022-12-10_10:33:17.732916) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:33:18.308241 run osmo-nitb_10.42.42.2(pid=29345): stdout: | (launched: 2022-12-10_10:33:17.688925) 10:33:18.437226 run osmo-nitb_10.42.42.2(pid=29345): stderr: | (launched: 2022-12-10_10:33:17.732916) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29345): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29345) [trial-2373↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29345)] 10:33:18.854652 tst osmo-nitb_10.42.42.2(pid=29345): stdout: | (launched: 2022-12-10_10:33:17.688925) 10:33:18.974780 tst osmo-nitb_10.42.42.2(pid=29345): stderr: | (launched: 2022-12-10_10:33:17.732916) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:33:19.116249 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29345): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29345) [trial-2373↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29345)] [trial-2373↪nitb_ussd:trx-lms↪assert_extension.py:12] 10:33:19.124563 tst assert_extension.py:12: Test FAILED (3.3 sec) 10:33:19.131111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29344): Terminating (SIGTERM) 10:33:19.341200 --- ParallelTerminationStrategy: PID 29344 died... 10:33:19.361405 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29344): Terminated: ok {rc=0} 10:33:19.448054 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:trx-lms --------------------------------------------------------------------- 10:33:20.628054 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:20.632180 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 10:33:20.668220 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:33:20.695894 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 10:33:20.731534 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 10:33:20.766675 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:33:20.794757 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 10:33:21.322167 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:trx-lms assert_extension.py ---------------------------------------------- 10:33:21.327574 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:21.339086 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 10:33:21.390170 tst assert_extension.py: using LAC 27786 10:33:21.516638 tst assert_extension.py: using RAC 246 10:33:21.640426 tst assert_extension.py: using CellId 27786 10:33:21.765120 tst assert_extension.py: using BVCI 27787 10:33:21.879732 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:21.890717 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:21.901592 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:21.912588 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:21.923728 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 10:33:21.934768 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 10:33:22.048632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:22.508095 run create_hlr_db(pid=29349): Launched 10:33:22.632245 bus /sierra_2: Setting Powered False 10:33:23.695401 run create_hlr_db(pid=29349): Terminated: ok {rc=0} 10:33:24.121076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29351): Launched 10:33:24.417700 run osmo-hlr_10.42.42.2(pid=29352): Launched 10:33:24.530793 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:25.053867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29354): Launched 10:33:25.350014 run osmo-stp_10.42.42.5(pid=29355): Launched 10:33:25.462474 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:25.997111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29357): Launched 10:33:26.293156 run osmo-msc_10.42.42.6(pid=29358): Launched 10:33:26.460391 run osmo-stp_10.42.42.5(pid=29355): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29355)] 10:33:26.586754 run osmo-stp_10.42.42.5(pid=29355): stdout: | (launched: 2022-12-10_10:33:25.296199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:26.712761 run osmo-stp_10.42.42.5(pid=29355): stderr: | 20221210103325466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103325466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103325466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103325466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103325467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103325467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103325467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:26.835935 run osmo-stp_10.42.42.5(pid=29355): stdout: | (launched: 2022-12-10_10:33:25.296199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:26.953945 run osmo-stp_10.42.42.5(pid=29355): stderr: | 20221210103325466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103325466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103325466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103325466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103325467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103325467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103325467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:27.095032 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29355): Process ended prematurely: osmo-stp_10.42.42.5(pid=29355) [trial-2373↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29355)] [trial-2373↪ussd:trx-lms↪assert_extension.py:17] 10:33:27.103129 tst assert_extension.py:17: Test FAILED (5.8 sec) 10:33:27.129255 run osmo-hlr_10.42.42.2(pid=29352): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29352)] 10:33:27.176833 run osmo-hlr_10.42.42.2(pid=29352): stdout: | (launched: 2022-12-10_10:33:24.363432) 10:33:27.226234 run osmo-hlr_10.42.42.2(pid=29352): stderr: | 20221210103324537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103324537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103324537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103324537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103324537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103324537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103324549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103324561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103324562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103324562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:27.294993 run osmo-msc_10.42.42.6(pid=29358): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29358)] 10:33:27.342769 run osmo-msc_10.42.42.6(pid=29358): stdout: | (launched: 2022-12-10_10:33:26.239250) 10:33:27.391953 run osmo-msc_10.42.42.6(pid=29358): stderr: | 20221210103326510 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103326510 DLGLOBAL DEBUG validating counter group 0x7f2018296c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103326510 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103326510 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103326510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103326511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103326515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103326516 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103326516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103326516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:27.441570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29351): Terminating (SIGTERM) 10:33:27.481069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29354): Terminating (SIGTERM) 10:33:27.520453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29357): Terminating (SIGTERM) 10:33:27.559999 --- ParallelTerminationStrategy: PID 29351 died... 10:33:27.579274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29351): Terminated: ok {rc=0} 10:33:27.623212 --- ParallelTerminationStrategy: PID 29354 died... 10:33:27.641730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29354): Terminated: ok {rc=0} 10:33:27.685501 --- ParallelTerminationStrategy: PID 29357 died... 10:33:27.704141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29357): Terminated: ok {rc=0} 10:33:27.790855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:33:29.005725 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:29.012471 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:33:29.045505 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:33:29.072175 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:33:29.124103 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:33:29.156649 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:33:29.182822 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:33:29.734812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:33:29.783566 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:29.794690 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:33:29.863742 tst mo_mt_call.py: using LAC 27787 10:33:29.982105 tst mo_mt_call.py: using RAC 247 10:33:30.102051 tst mo_mt_call.py: using CellId 27787 10:33:30.220178 tst mo_mt_call.py: using BVCI 27788 10:33:30.330117 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:30.341188 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:30.352123 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:30.363060 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:30.374141 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:30.384941 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:30.501658 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:30.618573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:31.118941 run create_hlr_db(pid=29363): Launched 10:33:31.272515 bus /sierra_2: Setting Powered False 10:33:32.337672 run create_hlr_db(pid=29363): Terminated: ok {rc=0} 10:33:32.769188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29365): Launched 10:33:33.070532 run osmo-hlr_10.42.42.2(pid=29366): Launched 10:33:33.185940 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:33.703460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29368): Launched 10:33:34.004475 run osmo-stp_10.42.42.5(pid=29369): Launched 10:33:34.119549 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:34.664323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29371): Launched 10:33:34.965417 run osmo-msc_10.42.42.6(pid=29372): Launched 10:33:35.134992 run osmo-stp_10.42.42.5(pid=29369): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29369)] 10:33:35.262819 run osmo-stp_10.42.42.5(pid=29369): stdout: | (launched: 2022-12-10_10:33:33.949796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:35.390825 run osmo-stp_10.42.42.5(pid=29369): stderr: | 20221210103334119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103334120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103334120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103334120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103334121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103334121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103334121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:35.516378 run osmo-stp_10.42.42.5(pid=29369): stdout: | (launched: 2022-12-10_10:33:33.949796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:35.635761 run osmo-stp_10.42.42.5(pid=29369): stderr: | 20221210103334119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103334120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103334120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103334120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103334121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103334121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103334121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:35.779122 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29369): Process ended prematurely: osmo-stp_10.42.42.5(pid=29369) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29369)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:33:35.787797 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:33:35.814125 run osmo-hlr_10.42.42.2(pid=29366): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29366)] 10:33:35.861808 run osmo-hlr_10.42.42.2(pid=29366): stdout: | (launched: 2022-12-10_10:33:33.015633) 10:33:35.911192 run osmo-hlr_10.42.42.2(pid=29366): stderr: | 20221210103333192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103333192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103333192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103333192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103333192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103333192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103333207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103333217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103333218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103333218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:35.979889 run osmo-msc_10.42.42.6(pid=29372): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29372)] 10:33:36.027587 run osmo-msc_10.42.42.6(pid=29372): stdout: | (launched: 2022-12-10_10:33:34.910756) 10:33:36.077089 run osmo-msc_10.42.42.6(pid=29372): stderr: | 20221210103335182 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103335182 DLGLOBAL DEBUG validating counter group 0x7f1ddccc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103335182 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103335182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103335183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103335183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103335186 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103335186 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103335186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103335186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:36.126686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29365): Terminating (SIGTERM) 10:33:36.166118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29368): Terminating (SIGTERM) 10:33:36.205679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29371): Terminating (SIGTERM) 10:33:36.245552 --- ParallelTerminationStrategy: PID 29365 died... 10:33:36.264519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29365): Terminated: ok {rc=0} 10:33:36.309085 --- ParallelTerminationStrategy: PID 29368 died... 10:33:36.327634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29368): Terminated: ok {rc=0} 10:33:36.371467 --- ParallelTerminationStrategy: PID 29371 died... 10:33:36.390128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29371): Terminated: ok {rc=0} 10:33:36.473698 bus /sierra_3: Setting Powered False 10:33:37.571805 bus /sierra_3: Setting Powered False 10:33:38.688729 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:33:39.836144 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:39.848499 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:33:39.920652 tst mo_mt_call_osmux.py: using LAC 27788 10:33:40.046620 tst mo_mt_call_osmux.py: using RAC 248 10:33:40.171513 tst mo_mt_call_osmux.py: using CellId 27788 10:33:40.291380 tst mo_mt_call_osmux.py: using BVCI 27789 10:33:40.401008 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:40.412449 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:40.423564 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:40.434692 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:40.445880 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:33:40.456848 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:40.575471 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:33:40.695782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:41.165047 run create_hlr_db(pid=29374): Launched 10:33:41.287992 bus /sierra_2: Setting Powered False 10:33:42.349191 run create_hlr_db(pid=29374): Terminated: ok {rc=0} 10:33:42.790016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29376): Launched 10:33:43.112395 run osmo-hlr_10.42.42.2(pid=29377): Launched 10:33:43.235729 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:43.794151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29379): Launched 10:33:44.117034 run osmo-stp_10.42.42.5(pid=29380): Launched 10:33:44.241445 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:44.825386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29382): Launched 10:33:45.147064 run osmo-msc_10.42.42.6(pid=29383): Launched 10:33:45.326809 run osmo-stp_10.42.42.5(pid=29380): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29380)] 10:33:45.463628 run osmo-stp_10.42.42.5(pid=29380): stdout: | (launched: 2022-12-10_10:33:44.058630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:45.600438 run osmo-stp_10.42.42.5(pid=29380): stderr: | 20221210103344249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103344249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103344250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103344250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103344252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103344252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103344252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:45.736317 run osmo-stp_10.42.42.5(pid=29380): stdout: | (launched: 2022-12-10_10:33:44.058630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:45.872305 run osmo-stp_10.42.42.5(pid=29380): stderr: | 20221210103344249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103344249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103344250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103344250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103344252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103344252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103344252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:46.030781 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29380): Process ended prematurely: osmo-stp_10.42.42.5(pid=29380) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29380)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:33:46.041246 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:33:46.072349 run osmo-hlr_10.42.42.2(pid=29377): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29377)] 10:33:46.124893 run osmo-hlr_10.42.42.2(pid=29377): stdout: | (launched: 2022-12-10_10:33:43.054347) 10:33:46.179017 run osmo-hlr_10.42.42.2(pid=29377): stderr: | 20221210103343251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103343251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103343251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103343251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103343251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103343251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103343263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103343271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103343271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103343271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:46.254180 run osmo-msc_10.42.42.6(pid=29383): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29383)] 10:33:46.306544 run osmo-msc_10.42.42.6(pid=29383): stdout: | (launched: 2022-12-10_10:33:45.089001) 10:33:46.360859 run osmo-msc_10.42.42.6(pid=29383): stderr: | 20221210103345412 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103345412 DLGLOBAL DEBUG validating counter group 0x7f2168519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103345412 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103345413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103345413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103345413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103345415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103345415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103345415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103345415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:46.415869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29376): Terminating (SIGTERM) 10:33:46.460529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29379): Terminating (SIGTERM) 10:33:46.506078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29382): Terminating (SIGTERM) 10:33:46.550171 --- ParallelTerminationStrategy: PID 29376 died... 10:33:46.570756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29376): Terminated: ok {rc=0} 10:33:46.620327 --- ParallelTerminationStrategy: PID 29379 died... 10:33:46.640792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29379): Terminated: ok {rc=0} 10:33:46.690100 --- ParallelTerminationStrategy: PID 29382 died... 10:33:46.710608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29382): Terminated: ok {rc=0} 10:33:46.802673 bus /sierra_3: Setting Powered False 10:33:47.899897 bus /sierra_3: Setting Powered False 10:33:49.016864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:33:50.269508 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:33:50.276580 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:33:50.311165 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:33:50.338833 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:33:50.389864 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:33:50.424211 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:33:50.451836 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:33:51.007966 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:33:51.059772 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:33:51.071225 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:33:51.140404 tst mo_mt_call.py: using LAC 27789 10:33:51.263977 tst mo_mt_call.py: using RAC 249 10:33:51.387775 tst mo_mt_call.py: using CellId 27789 10:33:51.505402 tst mo_mt_call.py: using BVCI 27790 10:33:51.615207 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:33:51.626487 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:33:51.637643 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:33:51.648706 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:33:51.659977 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:33:51.671556 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:33:51.791758 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:33:51.907682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:33:52.376309 run create_hlr_db(pid=29388): Launched 10:33:52.499872 bus /sierra_2: Setting Powered False 10:33:53.559842 run create_hlr_db(pid=29388): Terminated: ok {rc=0} 10:33:53.999985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29390): Launched 10:33:54.322505 run osmo-hlr_10.42.42.2(pid=29391): Launched 10:33:54.446755 run osmo-stp_10.42.42.5: Starting osmo-stp 10:33:55.006572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29393): Launched 10:33:55.328132 run osmo-stp_10.42.42.5(pid=29394): Launched 10:33:55.451657 run osmo-msc_10.42.42.6: Starting osmo-msc 10:33:56.037299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29396): Launched 10:33:56.359795 run osmo-msc_10.42.42.6(pid=29397): Launched 10:33:56.539894 run osmo-stp_10.42.42.5(pid=29394): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29394)] 10:33:56.680690 run osmo-stp_10.42.42.5(pid=29394): stdout: | (launched: 2022-12-10_10:33:55.269861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:56.818276 run osmo-stp_10.42.42.5(pid=29394): stderr: | 20221210103355463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103355463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103355463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103355464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103355464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103355464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103355464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:56.954420 run osmo-stp_10.42.42.5(pid=29394): stdout: | (launched: 2022-12-10_10:33:55.269861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:33:57.083170 run osmo-stp_10.42.42.5(pid=29394): stderr: | 20221210103355463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103355463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103355463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103355464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103355464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103355464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103355464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:33:57.236863 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29394): Process ended prematurely: osmo-stp_10.42.42.5(pid=29394) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29394)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:33:57.246588 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:33:57.275086 run osmo-hlr_10.42.42.2(pid=29391): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29391)] 10:33:57.325797 run osmo-hlr_10.42.42.2(pid=29391): stdout: | (launched: 2022-12-10_10:33:54.264280) 10:33:57.378195 run osmo-hlr_10.42.42.2(pid=29391): stderr: | 20221210103354461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103354461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103354461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103354461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103354461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103354462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103354474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103354482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103354482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103354482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:33:57.451054 run osmo-msc_10.42.42.6(pid=29397): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29397)] 10:33:57.502041 run osmo-msc_10.42.42.6(pid=29397): stdout: | (launched: 2022-12-10_10:33:56.301678) 10:33:57.554214 run osmo-msc_10.42.42.6(pid=29397): stderr: | 20221210103356623 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103356623 DLGLOBAL DEBUG validating counter group 0x7f7d26540c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103356623 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103356623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103356623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103356623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103356625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103356626 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103356626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103356626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:33:57.606851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29390): Terminating (SIGTERM) 10:33:57.648920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29393): Terminating (SIGTERM) 10:33:57.691238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29396): Terminating (SIGTERM) 10:33:57.733761 --- ParallelTerminationStrategy: PID 29390 died... 10:33:57.753700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29390): Terminated: ok {rc=0} 10:33:57.800745 --- ParallelTerminationStrategy: PID 29393 died... 10:33:57.820459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29393): Terminated: ok {rc=0} 10:33:57.867109 --- ParallelTerminationStrategy: PID 29396 died... 10:33:57.886751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29396): Terminated: ok {rc=0} 10:33:57.975509 bus /sierra_3: Setting Powered False 10:33:59.073421 bus /sierra_3: Setting Powered False 10:34:00.189679 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:34:01.338166 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:01.352238 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:34:01.425736 tst mo_mt_call_osmux.py: using LAC 27790 10:34:01.587643 tst mo_mt_call_osmux.py: using RAC 250 10:34:01.710028 tst mo_mt_call_osmux.py: using CellId 27790 10:34:01.832194 tst mo_mt_call_osmux.py: using BVCI 27791 10:34:01.984522 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:01.998192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:02.010747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:02.024758 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:02.038852 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:34:02.053229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:34:02.197511 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:34:02.321356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:02.824456 run create_hlr_db(pid=29400): Launched 10:34:02.948159 bus /sierra_2: Setting Powered False 10:34:04.012444 run create_hlr_db(pid=29400): Terminated: ok {rc=0} 10:34:04.445741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29402): Launched 10:34:04.751032 run osmo-hlr_10.42.42.2(pid=29403): Launched 10:34:04.866714 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:05.389969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29405): Launched 10:34:05.692120 run osmo-stp_10.42.42.5(pid=29406): Launched 10:34:05.807780 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:06.361407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29408): Launched 10:34:06.664642 run osmo-msc_10.42.42.6(pid=29409): Launched 10:34:06.836147 run osmo-stp_10.42.42.5(pid=29406): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29406)] 10:34:06.964124 run osmo-stp_10.42.42.5(pid=29406): stdout: | (launched: 2022-12-10_10:34:05.637350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:07.092562 run osmo-stp_10.42.42.5(pid=29406): stderr: | 20221210103405810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103405810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103405810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103405811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103405813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103405813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103405813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:07.218528 run osmo-stp_10.42.42.5(pid=29406): stdout: | (launched: 2022-12-10_10:34:05.637350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:07.338380 run osmo-stp_10.42.42.5(pid=29406): stderr: | 20221210103405810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103405810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103405810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103405811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103405813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103405813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103405813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:07.482015 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29406): Process ended prematurely: osmo-stp_10.42.42.5(pid=29406) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29406)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:34:07.490837 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:34:07.517466 run osmo-hlr_10.42.42.2(pid=29403): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29403)] 10:34:07.565646 run osmo-hlr_10.42.42.2(pid=29403): stdout: | (launched: 2022-12-10_10:34:04.695372) 10:34:07.615462 run osmo-hlr_10.42.42.2(pid=29403): stderr: | 20221210103404873 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103404873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103404873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103404873 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103404873 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103404873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103404888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103404899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103404899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103404899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:07.685143 run osmo-msc_10.42.42.6(pid=29409): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29409)] 10:34:07.733281 run osmo-msc_10.42.42.6(pid=29409): stdout: | (launched: 2022-12-10_10:34:06.609529) 10:34:07.783114 run osmo-msc_10.42.42.6(pid=29409): stderr: | 20221210103406882 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103406882 DLGLOBAL DEBUG validating counter group 0x7f23b9d9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103406882 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103406882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103406882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103406883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103406884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103406886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103406886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103406886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:07.833178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29402): Terminating (SIGTERM) 10:34:07.873180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29405): Terminating (SIGTERM) 10:34:07.913283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29408): Terminating (SIGTERM) 10:34:07.953487 --- ParallelTerminationStrategy: PID 29402 died... 10:34:07.972583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29402): Terminated: ok {rc=0} 10:34:08.017191 --- ParallelTerminationStrategy: PID 29405 died... 10:34:08.035910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29405): Terminated: ok {rc=0} 10:34:08.079982 --- ParallelTerminationStrategy: PID 29408 died... 10:34:08.098863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29408): Terminated: ok {rc=0} 10:34:08.186335 bus /sierra_3: Setting Powered False 10:34:09.286305 bus /sierra_3: Setting Powered False 10:34:10.401872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:34:11.652302 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:11.658902 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:34:11.691693 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:34:11.718191 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:34:11.770938 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:34:11.804031 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:34:11.830501 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:34:12.379965 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:34:12.428153 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:12.439473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:34:12.508291 tst mo_mt_call.py: using LAC 27791 10:34:12.626830 tst mo_mt_call.py: using RAC 251 10:34:12.746793 tst mo_mt_call.py: using CellId 27791 10:34:12.875033 tst mo_mt_call.py: using BVCI 27792 10:34:12.992296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:13.004141 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:13.015762 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:13.027930 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:13.040323 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:13.052497 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:13.171143 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:13.289796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:13.762551 run create_hlr_db(pid=29414): Launched 10:34:13.887168 bus /sierra_2: Setting Powered False 10:34:14.947776 run create_hlr_db(pid=29414): Terminated: ok {rc=0} 10:34:15.371606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29416): Launched 10:34:15.676614 run osmo-hlr_10.42.42.2(pid=29417): Launched 10:34:15.793615 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:16.474508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29419): Launched 10:34:16.826206 run osmo-stp_10.42.42.5(pid=29420): Launched 10:34:17.076132 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:17.675128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29422): Launched 10:34:17.997458 run osmo-msc_10.42.42.6(pid=29423): Launched 10:34:18.178452 run osmo-stp_10.42.42.5(pid=29420): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29420)] 10:34:18.319602 run osmo-stp_10.42.42.5(pid=29420): stdout: | (launched: 2022-12-10_10:34:16.757503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:18.456530 run osmo-stp_10.42.42.5(pid=29420): stderr: | 20221210103416942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103416942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103416942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103416943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103416943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103416943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103416943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:18.591708 run osmo-stp_10.42.42.5(pid=29420): stdout: | (launched: 2022-12-10_10:34:16.757503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:18.720267 run osmo-stp_10.42.42.5(pid=29420): stderr: | 20221210103416942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103416942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103416942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103416943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103416943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103416943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103416943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:18.874733 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29420): Process ended prematurely: osmo-stp_10.42.42.5(pid=29420) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29420)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:34:18.884078 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:34:18.912583 run osmo-hlr_10.42.42.2(pid=29417): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29417)] 10:34:18.962979 run osmo-hlr_10.42.42.2(pid=29417): stdout: | (launched: 2022-12-10_10:34:15.621472) 10:34:19.015002 run osmo-hlr_10.42.42.2(pid=29417): stderr: | 20221210103415798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103415799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103415799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103415799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103415799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103415799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103415811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103415819 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103415820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103415820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:19.087473 run osmo-msc_10.42.42.6(pid=29423): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29423)] 10:34:19.137827 run osmo-msc_10.42.42.6(pid=29423): stdout: | (launched: 2022-12-10_10:34:17.939309) 10:34:19.189892 run osmo-msc_10.42.42.6(pid=29423): stderr: | 20221210103418261 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103418261 DLGLOBAL DEBUG validating counter group 0x7f9de38a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103418261 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103418261 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103418261 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103418261 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103418263 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103418263 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103418264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103418264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:19.242420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29416): Terminating (SIGTERM) 10:34:19.284308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29419): Terminating (SIGTERM) 10:34:19.326524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29422): Terminating (SIGTERM) 10:34:19.368889 --- ParallelTerminationStrategy: PID 29416 died... 10:34:19.388810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29416): Terminated: ok {rc=0} 10:34:19.436100 --- ParallelTerminationStrategy: PID 29419 died... 10:34:19.455640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29419): Terminated: ok {rc=0} 10:34:19.502529 --- ParallelTerminationStrategy: PID 29422 died... 10:34:19.522119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29422): Terminated: ok {rc=0} 10:34:19.611237 bus /sierra_3: Setting Powered False 10:34:20.708514 bus /sierra_3: Setting Powered False 10:34:21.823985 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:34:22.972064 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:22.983900 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:34:23.054412 tst mo_mt_call_osmux.py: using LAC 27792 10:34:23.174559 tst mo_mt_call_osmux.py: using RAC 252 10:34:23.295241 tst mo_mt_call_osmux.py: using CellId 27792 10:34:23.416163 tst mo_mt_call_osmux.py: using BVCI 27793 10:34:23.526324 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:23.537358 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:23.548255 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:23.559265 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:23.570183 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:34:23.581057 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:23.695725 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:34:23.815236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:24.317853 run create_hlr_db(pid=29425): Launched 10:34:24.442808 bus /sierra_2: Setting Powered False 10:34:25.506912 run create_hlr_db(pid=29425): Terminated: ok {rc=0} 10:34:25.957144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Launched 10:34:26.281276 run osmo-hlr_10.42.42.2(pid=29428): Launched 10:34:26.405755 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:26.961086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Launched 10:34:27.284771 run osmo-stp_10.42.42.5(pid=29431): Launched 10:34:27.409447 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:27.996463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29433): Launched 10:34:28.319624 run osmo-msc_10.42.42.6(pid=29434): Launched 10:34:28.501161 run osmo-stp_10.42.42.5(pid=29431): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] 10:34:28.637526 run osmo-stp_10.42.42.5(pid=29431): stdout: | (launched: 2022-12-10_10:34:27.226323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:28.774867 run osmo-stp_10.42.42.5(pid=29431): stderr: | 20221210103427418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103427418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103427419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103427419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103427419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103427420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103427420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:28.911210 run osmo-stp_10.42.42.5(pid=29431): stdout: | (launched: 2022-12-10_10:34:27.226323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:29.039867 run osmo-stp_10.42.42.5(pid=29431): stderr: | 20221210103427418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103427418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103427419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103427419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103427419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103427420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103427420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:29.193694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29431): Process ended prematurely: osmo-stp_10.42.42.5(pid=29431) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:34:29.203150 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:34:29.231935 run osmo-hlr_10.42.42.2(pid=29428): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29428)] 10:34:29.282721 run osmo-hlr_10.42.42.2(pid=29428): stdout: | (launched: 2022-12-10_10:34:26.222456) 10:34:29.335346 run osmo-hlr_10.42.42.2(pid=29428): stderr: | 20221210103426420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103426420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103426421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103426421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103426421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103426421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103426437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103426446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103426446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103426446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:29.408246 run osmo-msc_10.42.42.6(pid=29434): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29434)] 10:34:29.459450 run osmo-msc_10.42.42.6(pid=29434): stdout: | (launched: 2022-12-10_10:34:28.261381) 10:34:29.512011 run osmo-msc_10.42.42.6(pid=29434): stderr: | 20221210103428582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103428582 DLGLOBAL DEBUG validating counter group 0x7fde30cf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103428582 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103428582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103428582 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103428582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103428584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103428584 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103428585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103428585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:29.565072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Terminating (SIGTERM) 10:34:29.607599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Terminating (SIGTERM) 10:34:29.650152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29433): Terminating (SIGTERM) 10:34:29.693342 --- ParallelTerminationStrategy: PID 29427 died... 10:34:29.713944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Terminated: ok {rc=0} 10:34:29.761160 --- ParallelTerminationStrategy: PID 29430 died... 10:34:29.780798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Terminated: ok {rc=0} 10:34:29.827942 --- ParallelTerminationStrategy: PID 29433 died... 10:34:29.847637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29433): Terminated: ok {rc=0} 10:34:29.936486 bus /sierra_3: Setting Powered False 10:34:31.033654 bus /sierra_3: Setting Powered False 10:34:32.150821 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:34:33.410881 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:33.417297 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:34:33.450510 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:34:33.477134 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:34:33.528380 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:34:33.561247 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:34:33.587677 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:34:34.140541 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:34:34.189195 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:34.200167 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:34:34.269105 tst mo_mt_call.py: using LAC 27793 10:34:34.401565 tst mo_mt_call.py: using RAC 253 10:34:34.524193 tst mo_mt_call.py: using CellId 27793 10:34:34.647147 tst mo_mt_call.py: using BVCI 27794 10:34:34.757159 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:34.768209 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:34.779126 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:34.790038 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:34.801017 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:34.811971 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:34.930421 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:35.046797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:35.516714 run create_hlr_db(pid=29439): Launched 10:34:35.641113 bus /sierra_2: Setting Powered False 10:34:36.701514 run create_hlr_db(pid=29439): Terminated: ok {rc=0} 10:34:37.143176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29441): Launched 10:34:37.465911 run osmo-hlr_10.42.42.2(pid=29442): Launched 10:34:37.589756 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:38.147537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29444): Launched 10:34:38.471207 run osmo-stp_10.42.42.5(pid=29445): Launched 10:34:38.594707 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:39.177723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29447): Launched 10:34:39.501886 run osmo-msc_10.42.42.6(pid=29448): Launched 10:34:39.682016 run osmo-stp_10.42.42.5(pid=29445): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29445)] 10:34:39.819538 run osmo-stp_10.42.42.5(pid=29445): stdout: | (launched: 2022-12-10_10:34:38.412244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:39.956333 run osmo-stp_10.42.42.5(pid=29445): stderr: | 20221210103438603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103438604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103438604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103438604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103438607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103438607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103438607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:40.091855 run osmo-stp_10.42.42.5(pid=29445): stdout: | (launched: 2022-12-10_10:34:38.412244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:40.219700 run osmo-stp_10.42.42.5(pid=29445): stderr: | 20221210103438603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103438604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103438604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103438604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103438607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103438607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103438607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:40.372937 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29445): Process ended prematurely: osmo-stp_10.42.42.5(pid=29445) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29445)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:34:40.382465 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:34:40.410945 run osmo-hlr_10.42.42.2(pid=29442): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29442)] 10:34:40.461811 run osmo-hlr_10.42.42.2(pid=29442): stdout: | (launched: 2022-12-10_10:34:37.407784) 10:34:40.514189 run osmo-hlr_10.42.42.2(pid=29442): stderr: | 20221210103437607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103437608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103437608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103437608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103437608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103437608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103437620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103437629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103437629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103437629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:40.586810 run osmo-msc_10.42.42.6(pid=29448): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29448)] 10:34:40.637368 run osmo-msc_10.42.42.6(pid=29448): stdout: | (launched: 2022-12-10_10:34:39.443354) 10:34:40.689556 run osmo-msc_10.42.42.6(pid=29448): stderr: | 20221210103439765 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103439765 DLGLOBAL DEBUG validating counter group 0x7fcefbc9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103439765 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103439765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103439765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103439766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103439769 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103439769 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103439770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103439770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:40.742281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29441): Terminating (SIGTERM) 10:34:40.784291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29444): Terminating (SIGTERM) 10:34:40.826385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29447): Terminating (SIGTERM) 10:34:40.868619 --- ParallelTerminationStrategy: PID 29441 died... 10:34:40.888578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29441): Terminated: ok {rc=0} 10:34:40.935070 --- ParallelTerminationStrategy: PID 29444 died... 10:34:40.954535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29444): Terminated: ok {rc=0} 10:34:41.000753 --- ParallelTerminationStrategy: PID 29447 died... 10:34:41.020347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29447): Terminated: ok {rc=0} 10:34:41.108898 bus /sierra_3: Setting Powered False 10:34:42.208163 bus /sierra_3: Setting Powered False 10:34:43.324555 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:34:44.473777 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:44.486137 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:34:44.558326 tst mo_mt_call_osmux.py: using LAC 27794 10:34:44.678819 tst mo_mt_call_osmux.py: using RAC 254 10:34:44.807332 tst mo_mt_call_osmux.py: using CellId 27794 10:34:44.933823 tst mo_mt_call_osmux.py: using BVCI 27795 10:34:45.052876 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:45.064648 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:45.076104 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:45.087731 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:45.099397 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:34:45.111014 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:45.227375 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:34:45.346242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:45.860357 run create_hlr_db(pid=29450): Launched 10:34:46.064489 bus /sierra_2: Setting Powered False 10:34:47.128063 run create_hlr_db(pid=29450): Terminated: ok {rc=0} 10:34:47.630989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29452): Launched 10:34:47.934738 run osmo-hlr_10.42.42.2(pid=29453): Launched 10:34:48.050510 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:48.572402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29455): Launched 10:34:48.876193 run osmo-stp_10.42.42.5(pid=29456): Launched 10:34:48.991817 run osmo-msc_10.42.42.6: Starting osmo-msc 10:34:49.543634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29458): Launched 10:34:49.849934 run osmo-msc_10.42.42.6(pid=29459): Launched 10:34:50.020793 run osmo-stp_10.42.42.5(pid=29456): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29456)] 10:34:50.150023 run osmo-stp_10.42.42.5(pid=29456): stdout: | (launched: 2022-12-10_10:34:48.820905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:50.279440 run osmo-stp_10.42.42.5(pid=29456): stderr: | 20221210103448992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103448992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103448992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103448992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103448993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103448993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103448993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:50.407012 run osmo-stp_10.42.42.5(pid=29456): stdout: | (launched: 2022-12-10_10:34:48.820905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:34:50.528162 run osmo-stp_10.42.42.5(pid=29456): stderr: | 20221210103448992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103448992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103448992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103448992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103448993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103448993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103448993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:34:50.673571 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29456): Process ended prematurely: osmo-stp_10.42.42.5(pid=29456) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29456)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:34:50.682381 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:34:50.709929 run osmo-hlr_10.42.42.2(pid=29453): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29453)] 10:34:50.758740 run osmo-hlr_10.42.42.2(pid=29453): stdout: | (launched: 2022-12-10_10:34:47.879976) 10:34:50.809298 run osmo-hlr_10.42.42.2(pid=29453): stderr: | 20221210103448058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103448058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103448058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103448058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103448058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103448058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103448073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103448083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103448084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103448084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:34:50.879445 run osmo-msc_10.42.42.6(pid=29459): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29459)] 10:34:50.928119 run osmo-msc_10.42.42.6(pid=29459): stdout: | (launched: 2022-12-10_10:34:49.794294) 10:34:50.978480 run osmo-msc_10.42.42.6(pid=29459): stderr: | 20221210103450065 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103450065 DLGLOBAL DEBUG validating counter group 0x7f4cc11fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103450065 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103450065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103450065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103450066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103450067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103450068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103450068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103450068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:34:51.029341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29452): Terminating (SIGTERM) 10:34:51.069921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29455): Terminating (SIGTERM) 10:34:51.111221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29458): Terminating (SIGTERM) 10:34:51.152204 --- ParallelTerminationStrategy: PID 29452 died... 10:34:51.171515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29452): Terminated: ok {rc=0} 10:34:51.216838 --- ParallelTerminationStrategy: PID 29455 died... 10:34:51.236068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29455): Terminated: ok {rc=0} 10:34:51.281501 --- ParallelTerminationStrategy: PID 29458 died... 10:34:51.300344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29458): Terminated: ok {rc=0} 10:34:51.387943 bus /sierra_3: Setting Powered False 10:34:52.488182 bus /sierra_3: Setting Powered False 10:34:53.603388 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:34:54.858205 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:34:54.864442 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:34:54.896935 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:34:54.923666 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:34:54.974920 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:34:55.007207 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:34:55.033104 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:34:55.584807 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:34:55.633092 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:34:55.644121 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:34:55.713474 tst mo_mt_call.py: using LAC 27795 10:34:55.842536 tst mo_mt_call.py: using RAC 255 10:34:55.968911 tst mo_mt_call.py: using CellId 27795 10:34:56.095512 tst mo_mt_call.py: using BVCI 27796 10:34:56.213223 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:34:56.224635 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:34:56.235927 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:34:56.247537 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:34:56.259167 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:34:56.270663 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:34:56.388000 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:34:56.508349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:34:57.009274 run create_hlr_db(pid=29464): Launched 10:34:57.133242 bus /sierra_2: Setting Powered False 10:34:58.197347 run create_hlr_db(pid=29464): Terminated: ok {rc=0} 10:34:58.631020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Launched 10:34:58.933893 run osmo-hlr_10.42.42.2(pid=29467): Launched 10:34:59.049103 run osmo-stp_10.42.42.5: Starting osmo-stp 10:34:59.581090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Launched 10:34:59.882830 run osmo-stp_10.42.42.5(pid=29470): Launched 10:34:59.997665 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:00.544699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29472): Launched 10:35:00.858507 run osmo-msc_10.42.42.6(pid=29473): Launched 10:35:01.095761 run osmo-stp_10.42.42.5(pid=29470): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] 10:35:01.435628 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-10_10:34:59.828195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:01.704496 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221210103459999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103459999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103459999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103500000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103500000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103500000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103500000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:01.845400 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-10_10:34:59.828195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:01.977926 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221210103459999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103459999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103459999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103500000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103500000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103500000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103500000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:02.134993 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:35:02.144508 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 10:35:02.175369 run osmo-hlr_10.42.42.2(pid=29467): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29467)] 10:35:02.227053 run osmo-hlr_10.42.42.2(pid=29467): stdout: | (launched: 2022-12-10_10:34:58.879204) 10:35:02.281982 run osmo-hlr_10.42.42.2(pid=29467): stderr: | 20221210103459054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103459054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103459054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103459054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103459054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103459054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103459066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103459077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103459077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103459077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:02.358405 run osmo-msc_10.42.42.6(pid=29473): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29473)] 10:35:02.410432 run osmo-msc_10.42.42.6(pid=29473): stdout: | (launched: 2022-12-10_10:35:00.792389) 10:35:02.463207 run osmo-msc_10.42.42.6(pid=29473): stderr: | 20221210103501318 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103501319 DLGLOBAL DEBUG validating counter group 0x7fe131eb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103501319 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103501319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103501319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103501319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103501322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103501322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103501322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103501322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:02.516533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminating (SIGTERM) 10:35:02.559761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminating (SIGTERM) 10:35:02.602646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29472): Terminating (SIGTERM) 10:35:02.645223 --- ParallelTerminationStrategy: PID 29466 died... 10:35:02.665299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminated: ok {rc=0} 10:35:02.712236 --- ParallelTerminationStrategy: PID 29469 died... 10:35:02.732362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminated: ok {rc=0} 10:35:02.780145 --- ParallelTerminationStrategy: PID 29472 died... 10:35:02.799828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29472): Terminated: ok {rc=0} 10:35:02.889168 bus /sierra_3: Setting Powered False 10:35:03.989243 bus /sierra_3: Setting Powered False 10:35:05.103924 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:35:06.249810 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:06.261556 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:35:06.331550 tst mo_mt_call_osmux.py: using LAC 27796 10:35:06.452767 tst mo_mt_call_osmux.py: using RAC 1 10:35:06.573018 tst mo_mt_call_osmux.py: using CellId 27796 10:35:06.692474 tst mo_mt_call_osmux.py: using BVCI 27797 10:35:06.803270 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:06.814362 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:06.825606 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:06.836477 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:06.847463 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:35:06.858445 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:35:06.976491 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:35:07.094593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:07.566427 run create_hlr_db(pid=29478): Launched 10:35:07.690059 bus /sierra_2: Setting Powered False 10:35:08.750393 run create_hlr_db(pid=29478): Terminated: ok {rc=0} 10:35:09.172575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Launched 10:35:09.475743 run osmo-hlr_10.42.42.2(pid=29481): Launched 10:35:09.590480 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:10.112943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Launched 10:35:10.414884 run osmo-stp_10.42.42.5(pid=29484): Launched 10:35:10.530438 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:11.075912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29486): Launched 10:35:11.378720 run osmo-msc_10.42.42.6(pid=29487): Launched 10:35:11.547030 run osmo-stp_10.42.42.5(pid=29484): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] 10:35:11.673917 run osmo-stp_10.42.42.5(pid=29484): stdout: | (launched: 2022-12-10_10:35:10.359958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:11.801290 run osmo-stp_10.42.42.5(pid=29484): stderr: | 20221210103510529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103510530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103510530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103510530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103510531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103510531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103510531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:11.926870 run osmo-stp_10.42.42.5(pid=29484): stdout: | (launched: 2022-12-10_10:35:10.359958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:12.046488 run osmo-stp_10.42.42.5(pid=29484): stderr: | 20221210103510529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103510530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103510530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103510530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103510531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103510531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103510531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:12.189977 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29484): Process ended prematurely: osmo-stp_10.42.42.5(pid=29484) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:35:12.198668 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:35:12.224992 run osmo-hlr_10.42.42.2(pid=29481): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29481)] 10:35:12.272286 run osmo-hlr_10.42.42.2(pid=29481): stdout: | (launched: 2022-12-10_10:35:09.420617) 10:35:12.321864 run osmo-hlr_10.42.42.2(pid=29481): stderr: | 20221210103509597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103509597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103509597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103509597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103509597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103509597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103509609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103509618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103509619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103509619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:12.390235 run osmo-msc_10.42.42.6(pid=29487): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29487)] 10:35:12.437807 run osmo-msc_10.42.42.6(pid=29487): stdout: | (launched: 2022-12-10_10:35:11.323836) 10:35:12.486783 run osmo-msc_10.42.42.6(pid=29487): stderr: | 20221210103511595 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103511597 DLGLOBAL DEBUG validating counter group 0x7f739f4d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103511597 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103511597 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103511597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103511597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103511599 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103511599 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103511600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103511600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:12.536050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Terminating (SIGTERM) 10:35:12.575569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Terminating (SIGTERM) 10:35:12.615008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29486): Terminating (SIGTERM) 10:35:12.654776 --- ParallelTerminationStrategy: PID 29480 died... 10:35:12.673853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Terminated: ok {rc=0} 10:35:12.718078 --- ParallelTerminationStrategy: PID 29483 died... 10:35:12.736679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Terminated: ok {rc=0} 10:35:12.780125 --- ParallelTerminationStrategy: PID 29486 died... 10:35:12.798605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29486): Terminated: ok {rc=0} 10:35:12.883622 bus /sierra_3: Setting Powered False 10:35:13.982968 bus /sierra_3: Setting Powered False 10:35:15.098510 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:35:16.354355 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:16.361330 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:35:16.401740 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:35:16.431087 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:35:16.490726 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:35:16.548426 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:35:16.591847 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:35:17.097880 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:35:17.154899 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:17.166691 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:35:17.236501 tst mo_mt_call.py: using LAC 27797 10:35:17.354864 tst mo_mt_call.py: using RAC 2 10:35:17.473478 tst mo_mt_call.py: using CellId 27797 10:35:17.600387 tst mo_mt_call.py: using BVCI 27798 10:35:17.718172 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:17.730148 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:17.741628 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:17.753473 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:17.765173 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:17.776704 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:17.895370 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:18.013270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:18.482832 run create_hlr_db(pid=29492): Launched 10:35:18.608256 bus /sierra_2: Setting Powered False 10:35:19.669284 run create_hlr_db(pid=29492): Terminated: ok {rc=0} 10:35:20.111349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29494): Launched 10:35:20.434880 run osmo-hlr_10.42.42.2(pid=29495): Launched 10:35:20.559999 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:21.118283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29497): Launched 10:35:21.441333 run osmo-stp_10.42.42.5(pid=29498): Launched 10:35:21.565895 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:22.150981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29500): Launched 10:35:22.473743 run osmo-msc_10.42.42.6(pid=29501): Launched 10:35:22.656439 run osmo-stp_10.42.42.5(pid=29498): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29498)] 10:35:22.792582 run osmo-stp_10.42.42.5(pid=29498): stdout: | (launched: 2022-12-10_10:35:21.383339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:22.929653 run osmo-stp_10.42.42.5(pid=29498): stderr: | 20221210103521576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103521576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103521576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103521576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103521577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103521577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103521577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:23.065789 run osmo-stp_10.42.42.5(pid=29498): stdout: | (launched: 2022-12-10_10:35:21.383339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:23.194041 run osmo-stp_10.42.42.5(pid=29498): stderr: | 20221210103521576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103521576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103521576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103521576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103521577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103521577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103521577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:23.347833 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29498): Process ended prematurely: osmo-stp_10.42.42.5(pid=29498) [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29498)] [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:35:23.357413 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:35:23.385763 run osmo-hlr_10.42.42.2(pid=29495): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29495)] 10:35:23.435836 run osmo-hlr_10.42.42.2(pid=29495): stdout: | (launched: 2022-12-10_10:35:20.376708) 10:35:23.488254 run osmo-hlr_10.42.42.2(pid=29495): stderr: | 20221210103520575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103520575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103520576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103520576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103520576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103520576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103520588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103520596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103520596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103520596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:23.560831 run osmo-msc_10.42.42.6(pid=29501): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29501)] 10:35:23.610979 run osmo-msc_10.42.42.6(pid=29501): stdout: | (launched: 2022-12-10_10:35:22.415162) 10:35:23.662820 run osmo-msc_10.42.42.6(pid=29501): stderr: | 20221210103522738 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103522738 DLGLOBAL DEBUG validating counter group 0x7f5ed9ad3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103522738 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103522738 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103522739 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103522739 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103522740 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103522741 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103522741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103522741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:23.715130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29494): Terminating (SIGTERM) 10:35:23.757056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29497): Terminating (SIGTERM) 10:35:23.798996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29500): Terminating (SIGTERM) 10:35:23.841694 --- ParallelTerminationStrategy: PID 29494 died... 10:35:23.861644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29494): Terminated: ok {rc=0} 10:35:23.908290 --- ParallelTerminationStrategy: PID 29497 died... 10:35:23.927837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29497): Terminated: ok {rc=0} 10:35:23.974214 --- ParallelTerminationStrategy: PID 29500 died... 10:35:23.993678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29500): Terminated: ok {rc=0} 10:35:24.082372 bus /sierra_3: Setting Powered False 10:35:25.181750 bus /sierra_3: Setting Powered False 10:35:26.298255 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:35:27.447669 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:27.460374 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:35:27.534917 tst mo_mt_call_osmux.py: using LAC 27798 10:35:27.663059 tst mo_mt_call_osmux.py: using RAC 3 10:35:27.789194 tst mo_mt_call_osmux.py: using CellId 27798 10:35:27.915482 tst mo_mt_call_osmux.py: using BVCI 27799 10:35:28.032938 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:28.044592 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:28.056157 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:28.068344 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:28.081619 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:35:28.093870 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:28.214249 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:35:28.333306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:28.834174 run create_hlr_db(pid=29503): Launched 10:35:28.957451 bus /sierra_2: Setting Powered False 10:35:30.021355 run create_hlr_db(pid=29503): Terminated: ok {rc=0} 10:35:30.453116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29505): Launched 10:35:30.757052 run osmo-hlr_10.42.42.2(pid=29506): Launched 10:35:30.881013 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:31.620017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29508): Launched 10:35:31.945943 run osmo-stp_10.42.42.5(pid=29509): Launched 10:35:32.219615 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:32.926638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29511): Launched 10:35:33.251417 run osmo-msc_10.42.42.6(pid=29512): Launched 10:35:33.431964 run osmo-stp_10.42.42.5(pid=29509): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29509)] 10:35:33.569462 run osmo-stp_10.42.42.5(pid=29509): stdout: | (launched: 2022-12-10_10:35:31.876579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:33.707340 run osmo-stp_10.42.42.5(pid=29509): stderr: | 20221210103532152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103532152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103532153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103532155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103532155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103532155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103532155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:33.843590 run osmo-stp_10.42.42.5(pid=29509): stdout: | (launched: 2022-12-10_10:35:31.876579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:33.972385 run osmo-stp_10.42.42.5(pid=29509): stderr: | 20221210103532152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103532152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103532153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103532155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103532155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103532155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103532155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:34.127041 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29509): Process ended prematurely: osmo-stp_10.42.42.5(pid=29509) [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29509)] [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:35:34.136438 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 10:35:34.165179 run osmo-hlr_10.42.42.2(pid=29506): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29506)] 10:35:34.215565 run osmo-hlr_10.42.42.2(pid=29506): stdout: | (launched: 2022-12-10_10:35:30.701382) 10:35:34.267642 run osmo-hlr_10.42.42.2(pid=29506): stderr: | 20221210103530935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103530935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103530935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103530935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103530935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103530935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103530959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103530975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103530976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103530976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:34.340492 run osmo-msc_10.42.42.6(pid=29512): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29512)] 10:35:34.390871 run osmo-msc_10.42.42.6(pid=29512): stdout: | (launched: 2022-12-10_10:35:33.192867) 10:35:34.443267 run osmo-msc_10.42.42.6(pid=29512): stderr: | 20221210103533517 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103533517 DLGLOBAL DEBUG validating counter group 0x7f9037547c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103533517 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103533517 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103533517 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103533518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103533519 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103533520 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103533520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103533520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:34.496043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29505): Terminating (SIGTERM) 10:35:34.538281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29508): Terminating (SIGTERM) 10:35:34.580523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29511): Terminating (SIGTERM) 10:35:34.622959 --- ParallelTerminationStrategy: PID 29505 died... 10:35:34.643076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29505): Terminated: ok {rc=0} 10:35:34.689790 --- ParallelTerminationStrategy: PID 29508 died... 10:35:34.709288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29508): Terminated: ok {rc=0} 10:35:34.755784 --- ParallelTerminationStrategy: PID 29511 died... 10:35:34.775429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29511): Terminated: ok {rc=0} 10:35:34.863514 bus /sierra_3: Setting Powered False 10:35:35.962898 bus /sierra_3: Setting Powered False 10:35:37.081123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:35:38.333075 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:38.338958 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:35:38.371756 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:35:38.398141 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:35:38.451902 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:35:38.486320 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:35:38.513791 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:35:39.058106 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:35:39.106435 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:39.117475 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:35:39.187772 tst mo_mt_call.py: using LAC 27799 10:35:39.308224 tst mo_mt_call.py: using RAC 4 10:35:39.428342 tst mo_mt_call.py: using CellId 27799 10:35:39.549578 tst mo_mt_call.py: using BVCI 27800 10:35:39.669057 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:39.680632 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:39.691753 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:39.703431 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:39.715009 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:39.726658 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:35:39.844044 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:35:39.964207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:40.467188 run create_hlr_db(pid=29517): Launched 10:35:40.590975 bus /sierra_2: Setting Powered False 10:35:41.654497 run create_hlr_db(pid=29517): Terminated: ok {rc=0} 10:35:42.088131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29519): Launched 10:35:42.392362 run osmo-hlr_10.42.42.2(pid=29520): Launched 10:35:42.508297 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:43.044671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29522): Launched 10:35:43.347972 run osmo-stp_10.42.42.5(pid=29523): Launched 10:35:43.463611 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:44.013031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29525): Launched 10:35:44.315667 run osmo-msc_10.42.42.6(pid=29526): Launched 10:35:44.485674 run osmo-stp_10.42.42.5(pid=29523): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29523)] 10:35:44.614483 run osmo-stp_10.42.42.5(pid=29523): stdout: | (launched: 2022-12-10_10:35:43.292169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:44.742982 run osmo-stp_10.42.42.5(pid=29523): stderr: | 20221210103543464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103543464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103543465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103543465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103543465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103543465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103543466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:44.869669 run osmo-stp_10.42.42.5(pid=29523): stdout: | (launched: 2022-12-10_10:35:43.292169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:44.990248 run osmo-stp_10.42.42.5(pid=29523): stderr: | 20221210103543464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103543464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103543465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103543465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103543465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103543465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103543466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:45.135129 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29523): Process ended prematurely: osmo-stp_10.42.42.5(pid=29523) [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29523)] [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:35:45.143823 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:35:45.170002 run osmo-hlr_10.42.42.2(pid=29520): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29520)] 10:35:45.217511 run osmo-hlr_10.42.42.2(pid=29520): stdout: | (launched: 2022-12-10_10:35:42.337284) 10:35:45.266670 run osmo-hlr_10.42.42.2(pid=29520): stderr: | 20221210103542511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103542511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103542511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103542512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103542512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103542512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103542524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103542534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103542535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103542535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:45.335574 run osmo-msc_10.42.42.6(pid=29526): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29526)] 10:35:45.383459 run osmo-msc_10.42.42.6(pid=29526): stdout: | (launched: 2022-12-10_10:35:44.260474) 10:35:45.432342 run osmo-msc_10.42.42.6(pid=29526): stderr: | 20221210103544532 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103544533 DLGLOBAL DEBUG validating counter group 0x7f28407f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103544533 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103544533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103544533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103544533 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103544536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103544537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103544537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103544537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:45.481428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29519): Terminating (SIGTERM) 10:35:45.520918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29522): Terminating (SIGTERM) 10:35:45.560658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29525): Terminating (SIGTERM) 10:35:45.600209 --- ParallelTerminationStrategy: PID 29519 died... 10:35:45.619273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29519): Terminated: ok {rc=0} 10:35:45.662977 --- ParallelTerminationStrategy: PID 29522 died... 10:35:45.681323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29522): Terminated: ok {rc=0} 10:35:45.724542 --- ParallelTerminationStrategy: PID 29525 died... 10:35:45.742959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29525): Terminated: ok {rc=0} 10:35:45.828159 bus /sierra_3: Setting Powered False 10:35:46.928540 bus /sierra_3: Setting Powered False 10:35:48.046818 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:35:49.195439 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:49.207629 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:35:49.280848 tst mo_mt_call_osmux.py: using LAC 27800 10:35:49.408591 tst mo_mt_call_osmux.py: using RAC 5 10:35:49.540110 tst mo_mt_call_osmux.py: using CellId 27800 10:35:49.666079 tst mo_mt_call_osmux.py: using BVCI 27801 10:35:49.783025 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:49.794333 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:49.805516 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:49.816838 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:49.828382 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:35:49.839756 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:35:49.960018 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:35:50.077457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:35:50.546997 run create_hlr_db(pid=29528): Launched 10:35:50.670579 bus /sierra_2: Setting Powered False 10:35:51.730743 run create_hlr_db(pid=29528): Terminated: ok {rc=0} 10:35:52.152366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29530): Launched 10:35:52.453917 run osmo-hlr_10.42.42.2(pid=29531): Launched 10:35:52.568433 run osmo-stp_10.42.42.5: Starting osmo-stp 10:35:53.100090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29533): Launched 10:35:53.402108 run osmo-stp_10.42.42.5(pid=29534): Launched 10:35:53.517818 run osmo-msc_10.42.42.6: Starting osmo-msc 10:35:54.064250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29536): Launched 10:35:54.366293 run osmo-msc_10.42.42.6(pid=29537): Launched 10:35:54.535487 run osmo-stp_10.42.42.5(pid=29534): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29534)] 10:35:54.663202 run osmo-stp_10.42.42.5(pid=29534): stdout: | (launched: 2022-12-10_10:35:53.347255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:54.790824 run osmo-stp_10.42.42.5(pid=29534): stderr: | 20221210103553517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103553517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103553517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103553518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103553518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103553518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103553518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:54.916810 run osmo-stp_10.42.42.5(pid=29534): stdout: | (launched: 2022-12-10_10:35:53.347255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:35:55.036345 run osmo-stp_10.42.42.5(pid=29534): stderr: | 20221210103553517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103553517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103553517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103553518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103553518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103553518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103553518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:35:55.180455 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29534): Process ended prematurely: osmo-stp_10.42.42.5(pid=29534) [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29534)] [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:35:55.189234 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:35:55.215943 run osmo-hlr_10.42.42.2(pid=29531): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29531)] 10:35:55.263471 run osmo-hlr_10.42.42.2(pid=29531): stdout: | (launched: 2022-12-10_10:35:52.399084) 10:35:55.312857 run osmo-hlr_10.42.42.2(pid=29531): stderr: | 20221210103552576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103552576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103552576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103552577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103552577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103552577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103552589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103552598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103552598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103552598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:35:55.381425 run osmo-msc_10.42.42.6(pid=29537): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29537)] 10:35:55.429194 run osmo-msc_10.42.42.6(pid=29537): stdout: | (launched: 2022-12-10_10:35:54.311427) 10:35:55.478454 run osmo-msc_10.42.42.6(pid=29537): stderr: | 20221210103554583 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103554583 DLGLOBAL DEBUG validating counter group 0x7f8edc5b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103554583 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103554583 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103554584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103554584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103554585 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103554586 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103554586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103554586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:35:55.528111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29530): Terminating (SIGTERM) 10:35:55.567865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29533): Terminating (SIGTERM) 10:35:55.608071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29536): Terminating (SIGTERM) 10:35:55.648238 --- ParallelTerminationStrategy: PID 29530 died... 10:35:55.667404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29530): Terminated: ok {rc=0} 10:35:55.711721 --- ParallelTerminationStrategy: PID 29533 died... 10:35:55.730243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29533): Terminated: ok {rc=0} 10:35:55.774152 --- ParallelTerminationStrategy: PID 29536 died... 10:35:55.792915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29536): Terminated: ok {rc=0} 10:35:55.877098 bus /sierra_3: Setting Powered False 10:35:56.975491 bus /sierra_3: Setting Powered False 10:35:58.096297 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:trx-lms --------------------------------------------------------------------- 10:35:59.347689 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:35:59.352363 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 10:35:59.385739 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 10:35:59.412393 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 10:35:59.496940 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 10:35:59.529559 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 10:35:59.555898 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 10:36:00.139520 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 10:36:00.144443 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:00.155138 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:36:00.204879 tst emergency_mo_mt_call.py: using LAC 27801 10:36:00.320747 tst emergency_mo_mt_call.py: using RAC 6 10:36:00.437168 tst emergency_mo_mt_call.py: using CellId 27801 10:36:00.555807 tst emergency_mo_mt_call.py: using BVCI 27802 10:36:00.674432 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:00.685794 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:00.696773 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:00.708641 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:00.720482 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:00.732225 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:36:00.860724 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:36:00.991304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:01.514602 run create_hlr_db(pid=29542): Launched 10:36:01.695901 bus /sierra_2: Setting Powered False 10:36:02.759369 run create_hlr_db(pid=29542): Terminated: ok {rc=0} 10:36:03.187342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29544): Launched 10:36:03.483795 run osmo-hlr_10.42.42.2(pid=29545): Launched 10:36:03.598130 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:04.117523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29547): Launched 10:36:04.414761 run osmo-stp_10.42.42.5(pid=29548): Launched 10:36:04.543570 tst emergency_mo_mt_call.py: using MSISDN 7687 10:36:04.695687 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:05.230081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29550): Launched 10:36:05.526873 run osmo-msc_10.42.42.6(pid=29551): Launched 10:36:05.694711 run osmo-stp_10.42.42.5(pid=29548): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29548)] 10:36:05.820703 run osmo-stp_10.42.42.5(pid=29548): stdout: | (launched: 2022-12-10_10:36:04.360451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:05.947024 run osmo-stp_10.42.42.5(pid=29548): stderr: | 20221210103604529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103604529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103604530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103604530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103604531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103604531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103604531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:06.070445 run osmo-stp_10.42.42.5(pid=29548): stdout: | (launched: 2022-12-10_10:36:04.360451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:06.188173 run osmo-stp_10.42.42.5(pid=29548): stderr: | 20221210103604529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103604529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103604530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103604530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103604531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103604531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103604531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:06.329497 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29548): Process ended prematurely: osmo-stp_10.42.42.5(pid=29548) [trial-2373↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29548)] [trial-2373↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 10:36:06.337587 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 10:36:06.363364 run osmo-hlr_10.42.42.2(pid=29545): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29545)] 10:36:06.410338 run osmo-hlr_10.42.42.2(pid=29545): stdout: | (launched: 2022-12-10_10:36:03.430127) 10:36:06.459136 run osmo-hlr_10.42.42.2(pid=29545): stderr: | 20221210103603609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103603609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103603609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103603609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103603609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103603609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103603622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103603630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103603630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103603630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:06.527376 run osmo-msc_10.42.42.6(pid=29551): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29551)] 10:36:06.574823 run osmo-msc_10.42.42.6(pid=29551): stdout: | (launched: 2022-12-10_10:36:05.472276) 10:36:06.623644 run osmo-msc_10.42.42.6(pid=29551): stderr: | 20221210103605745 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103605745 DLGLOBAL DEBUG validating counter group 0x7f020d483c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103605745 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103605745 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103605746 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103605746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103605748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103605749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103605749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103605749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:06.672834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29544): Terminating (SIGTERM) 10:36:06.711891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29547): Terminating (SIGTERM) 10:36:06.751056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29550): Terminating (SIGTERM) 10:36:06.790550 --- ParallelTerminationStrategy: PID 29544 died... 10:36:06.809396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29544): Terminated: ok {rc=0} 10:36:06.853002 --- ParallelTerminationStrategy: PID 29547 died... 10:36:06.871313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29547): Terminated: ok {rc=0} 10:36:06.914517 --- ParallelTerminationStrategy: PID 29550 died... 10:36:06.933060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29550): Terminated: ok {rc=0} 10:36:07.017409 bus /sierra_3: Setting Powered False 10:36:08.115843 bus /sierra_3: Setting Powered False 10:36:09.231194 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 10:36:10.317792 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:10.330154 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 10:36:10.384106 tst emergency_preemptive_call.py: using LAC 27802 10:36:10.511903 tst emergency_preemptive_call.py: using RAC 7 10:36:10.636436 tst emergency_preemptive_call.py: using CellId 27802 10:36:10.759732 tst emergency_preemptive_call.py: using BVCI 27803 10:36:10.876330 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:10.887500 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:10.898494 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:10.909796 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:10.921031 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 10:36:10.932167 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:36:11.050733 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:36:11.168333 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:36:11.281430 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 10:36:11.397662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:11.890275 run create_hlr_db(pid=29553): Launched 10:36:12.010780 bus /sierra_2: Setting Powered False 10:36:13.073851 run create_hlr_db(pid=29553): Terminated: ok {rc=0} 10:36:13.498573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29555): Launched 10:36:13.797673 run osmo-hlr_10.42.42.2(pid=29556): Launched 10:36:13.911591 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:14.437322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29558): Launched 10:36:14.733658 run osmo-stp_10.42.42.5(pid=29559): Launched 10:36:14.856921 tst emergency_preemptive_call.py: using MSISDN 7688 10:36:15.007608 run osmo-msc_10.42.42.6: Starting osmo-msc 10:36:15.538860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29561): Launched 10:36:15.847164 run osmo-msc_10.42.42.6(pid=29562): Launched 10:36:16.064802 run osmo-stp_10.42.42.5(pid=29559): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29559)] 10:36:16.258847 run osmo-stp_10.42.42.5(pid=29559): stdout: | (launched: 2022-12-10_10:36:14.679401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:16.485998 run osmo-stp_10.42.42.5(pid=29559): stderr: | 20221210103614850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103614851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103614851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103614851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103614852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103614852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103614852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:16.787904 run osmo-stp_10.42.42.5(pid=29559): stdout: | (launched: 2022-12-10_10:36:14.679401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:17.051653 run osmo-stp_10.42.42.5(pid=29559): stderr: | 20221210103614850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103614851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103614851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103614851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103614852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103614852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103614852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:17.207222 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29559): Process ended prematurely: osmo-stp_10.42.42.5(pid=29559) [trial-2373↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29559)] [trial-2373↪emergency:trx-lms↪emergency_preemptive_call.py:32] 10:36:17.216298 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 10:36:17.246171 run osmo-hlr_10.42.42.2(pid=29556): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29556)] 10:36:17.297834 run osmo-hlr_10.42.42.2(pid=29556): stdout: | (launched: 2022-12-10_10:36:13.742888) 10:36:17.351705 run osmo-hlr_10.42.42.2(pid=29556): stderr: | 20221210103613920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103613920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103613920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103613920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103613920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103613921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103613932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103613942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103613942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103613942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:17.427039 run osmo-msc_10.42.42.6(pid=29562): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29562)] 10:36:17.478811 run osmo-msc_10.42.42.6(pid=29562): stdout: | (launched: 2022-12-10_10:36:15.781841) 10:36:17.533322 run osmo-msc_10.42.42.6(pid=29562): stderr: | 20221210103616541 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210103616541 DLGLOBAL DEBUG validating counter group 0x7fbb6ed37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210103616544 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210103616544 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210103616544 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210103616544 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210103616546 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210103616547 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210103616547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210103616547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:36:17.588744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29555): Terminating (SIGTERM) 10:36:17.631265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29558): Terminating (SIGTERM) 10:36:17.674333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29561): Terminating (SIGTERM) 10:36:17.717885 --- ParallelTerminationStrategy: PID 29555 died... 10:36:17.737559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29555): Terminated: ok {rc=0} 10:36:17.786289 --- ParallelTerminationStrategy: PID 29558 died... 10:36:17.806006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29558): Terminated: ok {rc=0} 10:36:17.853992 --- ParallelTerminationStrategy: PID 29561 died... 10:36:17.873697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29561): Terminated: ok {rc=0} 10:36:17.962172 bus /sierra_9: Setting Powered False 10:36:19.060677 bus /sierra_9: Setting Powered False 10:36:20.176230 bus /sierra_8: Setting Powered False 10:36:21.274034 bus /sierra_8: Setting Powered False 10:36:22.390912 bus /sierra_3: Setting Powered False 10:36:23.489249 bus /sierra_3: Setting Powered False 10:36:24.605492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms --------------------------------------------------------------------- 10:36:25.884434 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:36:25.888708 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 10:36:25.921566 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 10:36:25.959843 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 10:36:26.046815 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 10:36:26.080807 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 10:36:26.119041 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 10:36:26.710636 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 10:36:26.764287 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:26.775469 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:36:26.825959 tst cs_paging_gprs_active.py: using LAC 27803 10:36:26.952096 tst cs_paging_gprs_active.py: using RAC 8 10:36:27.078160 tst cs_paging_gprs_active.py: using CellId 27803 10:36:27.208380 tst cs_paging_gprs_active.py: using BVCI 27804 10:36:27.327727 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.338921 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.349798 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.361109 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.372353 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.383620 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.394959 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.406152 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:27.417819 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:36:27.534425 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:36:27.653978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:36:27.873970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:28.199978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29567): Launched 10:36:28.482885 run iperf3-srv_10.42.42.10(pid=29568): Launched 10:36:28.605830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:36:28.824212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:29.149682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29569): Launched 10:36:29.433693 run iperf3-srv_10.42.42.10(pid=29570): Launched 10:36:29.557358 tst cs_paging_gprs_active.py:38: start network... 10:36:29.777915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:30.281542 run create_hlr_db(pid=29571): Launched 10:36:30.405964 bus /sierra_2: Setting Powered False 10:36:31.468516 run create_hlr_db(pid=29571): Terminated: ok {rc=0} 10:36:31.969874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Launched 10:36:32.282941 run osmo-hlr_10.42.42.2(pid=29574): Launched 10:36:32.401602 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:32.927139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Launched 10:36:33.231340 run osmo-stp_10.42.42.5(pid=29577): Launched 10:36:33.347729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:33.871758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29579): Launched 10:36:33.988897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:34.245506 run patchelf(pid=29580): Launched 10:36:34.415607 run osmo-stp_10.42.42.5(pid=29577): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] 10:36:34.544462 run osmo-stp_10.42.42.5(pid=29577): stdout: | (launched: 2022-12-10_10:36:33.175822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:34.675049 run osmo-stp_10.42.42.5(pid=29577): stderr: | 20221210103633345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103633345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103633346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103633346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103633347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103633347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103633347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:34.805649 run osmo-stp_10.42.42.5(pid=29577): stdout: | (launched: 2022-12-10_10:36:33.175822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:34.930391 run osmo-stp_10.42.42.5(pid=29577): stderr: | 20221210103633345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103633345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103633346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103633346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103633347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103633347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103633347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:35.078606 run patchelf(pid=29580): Terminating (SIGINT) 10:36:35.250171 run patchelf(pid=29580): Terminated: ok {rc=0} 10:36:35.373744 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29577): Process ended prematurely: osmo-stp_10.42.42.5(pid=29577) [trial-2373↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] [trial-2373↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 10:36:35.383094 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:36:35.410181 run osmo-hlr_10.42.42.2(pid=29574): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29574)] 10:36:35.457226 run osmo-hlr_10.42.42.2(pid=29574): stdout: | (launched: 2022-12-10_10:36:32.227196) 10:36:35.505947 run osmo-hlr_10.42.42.2(pid=29574): stderr: | 20221210103632405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103632405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103632405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103632405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103632405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103632405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103632421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103632430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103632430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103632430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:35.555242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29567): Terminating (SIGTERM) 10:36:35.594804 run iperf3-srv_10.42.42.10(pid=29568): Terminating (SIGTERM) 10:36:35.634265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29569): Terminating (SIGTERM) 10:36:35.673687 run iperf3-srv_10.42.42.10(pid=29570): Terminating (SIGTERM) 10:36:35.712891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminating (SIGTERM) 10:36:35.752348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Terminating (SIGTERM) 10:36:35.791664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29579): Terminating (SIGTERM) 10:36:35.831164 --- ParallelTerminationStrategy: PID 29567 died... 10:36:35.850087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29567): Terminated: ok {rc=0} 10:36:35.893673 --- ParallelTerminationStrategy: PID 29568 died... 10:36:35.912107 run iperf3-srv_10.42.42.10(pid=29568): Terminated {rc=256} 10:36:35.956283 --- ParallelTerminationStrategy: PID 29569 died... 10:36:35.974891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29569): Terminated: ok {rc=0} 10:36:36.018509 --- ParallelTerminationStrategy: PID 29570 died... 10:36:36.036981 run iperf3-srv_10.42.42.10(pid=29570): Terminated {rc=256} 10:36:36.080443 --- ParallelTerminationStrategy: PID 29573 died... 10:36:36.099365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminated: ok {rc=0} 10:36:36.142935 --- ParallelTerminationStrategy: PID 29576 died... 10:36:36.161477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Terminated: ok {rc=0} 10:36:36.205065 --- ParallelTerminationStrategy: PID 29579 died... 10:36:36.223514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29579): Terminated: ok {rc=0} 10:36:36.308439 bus /gobi_0: Setting Powered False 10:36:37.408501 bus /gobi_0: Setting Powered False 10:36:38.524122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms iperf3.py ---------------------------------------------- 10:36:39.673714 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:39.684788 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:36:39.738460 tst iperf3.py: using LAC 27804 10:36:39.860282 tst iperf3.py: using RAC 9 10:36:39.980763 tst iperf3.py: using CellId 27804 10:36:40.102416 tst iperf3.py: using BVCI 27805 10:36:40.214321 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.224995 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.235488 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.246478 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.257380 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.268358 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.279383 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.290295 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:40.301360 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:36:40.415336 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:36:40.619646 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:40.924083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29581): Launched 10:36:41.189500 run iperf3-srv_10.42.42.10(pid=29582): Launched 10:36:41.304411 tst iperf3.py:8: start network... 10:36:41.508562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:41.979743 run create_hlr_db(pid=29583): Launched 10:36:42.103936 bus /gobi_6: Setting Powered False 10:36:43.163741 run create_hlr_db(pid=29583): Terminated: ok {rc=0} 10:36:43.605958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29585): Launched 10:36:43.929275 run osmo-hlr_10.42.42.2(pid=29586): Launched 10:36:44.053371 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:44.614590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29588): Launched 10:36:44.938242 run osmo-stp_10.42.42.5(pid=29589): Launched 10:36:45.063103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:45.620859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29591): Launched 10:36:45.745666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:46.052792 run patchelf(pid=29592): Launched 10:36:46.247816 run osmo-stp_10.42.42.5(pid=29589): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29589)] 10:36:46.388664 run osmo-stp_10.42.42.5(pid=29589): stdout: | (launched: 2022-12-10_10:36:44.879973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:46.530847 run osmo-stp_10.42.42.5(pid=29589): stderr: | 20221210103645070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103645070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103645071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103645071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103645071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103645072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103645072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:46.673954 run osmo-stp_10.42.42.5(pid=29589): stdout: | (launched: 2022-12-10_10:36:44.879973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:46.810162 run osmo-stp_10.42.42.5(pid=29589): stderr: | 20221210103645070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103645070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103645071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103645071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103645071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103645072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103645072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:46.971331 run patchelf(pid=29592): Terminating (SIGINT) 10:36:47.157207 run patchelf(pid=29592): Terminated: ok {rc=0} 10:36:47.280704 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29589): Process ended prematurely: osmo-stp_10.42.42.5(pid=29589) [trial-2373↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29589)] [trial-2373↪gprs:trx-lms↪iperf3.py:8] 10:36:47.290144 tst iperf3.py:8: Test FAILED (7.7 sec) 10:36:47.317393 run osmo-hlr_10.42.42.2(pid=29586): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29586)] 10:36:47.365368 run osmo-hlr_10.42.42.2(pid=29586): stdout: | (launched: 2022-12-10_10:36:43.870903) 10:36:47.414839 run osmo-hlr_10.42.42.2(pid=29586): stderr: | 20221210103644071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103644071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103644071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103644071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103644071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103644071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103644083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103644091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103644091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103644092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:36:47.464227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29581): Terminating (SIGTERM) 10:36:47.504153 run iperf3-srv_10.42.42.10(pid=29582): Terminating (SIGTERM) 10:36:47.543781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29585): Terminating (SIGTERM) 10:36:47.583369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29588): Terminating (SIGTERM) 10:36:47.622920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29591): Terminating (SIGTERM) 10:36:47.663246 --- ParallelTerminationStrategy: PID 29581 died... 10:36:47.682118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29581): Terminated: ok {rc=0} 10:36:47.726102 --- ParallelTerminationStrategy: PID 29582 died... 10:36:47.744670 run iperf3-srv_10.42.42.10(pid=29582): Terminated {rc=256} 10:36:47.788688 --- ParallelTerminationStrategy: PID 29585 died... 10:36:47.807296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29585): Terminated: ok {rc=0} 10:36:47.851682 --- ParallelTerminationStrategy: PID 29588 died... 10:36:47.870357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29588): Terminated: ok {rc=0} 10:36:47.914552 --- ParallelTerminationStrategy: PID 29591 died... 10:36:47.933310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29591): Terminated: ok {rc=0} 10:36:48.017539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms iperf3m4.py ---------------------------------------------- 10:36:49.166594 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.178308 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:36:49.230689 tst iperf3m4.py: using LAC 27805 10:36:49.359090 tst iperf3m4.py: using RAC 10 10:36:49.485458 tst iperf3m4.py: using CellId 27805 10:36:49.606594 tst iperf3m4.py: using BVCI 27806 10:36:49.726087 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.737447 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.748459 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.761258 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.772876 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.785076 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.796930 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.808886 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:36:49.820792 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:36:49.941159 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:36:50.064463 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:36:50.183807 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:36:50.304258 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:36:50.523585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:50.847864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29593): Launched 10:36:51.129756 run iperf3-srv_10.42.42.10(pid=29594): Launched 10:36:51.251317 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:36:51.470333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:51.795644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29595): Launched 10:36:52.078834 run iperf3-srv_10.42.42.10(pid=29596): Launched 10:36:52.200600 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:36:52.419081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:52.744360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29597): Launched 10:36:53.025653 run iperf3-srv_10.42.42.10(pid=29598): Launched 10:36:53.147715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:36:53.366504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:36:53.691955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29599): Launched 10:36:53.973220 run iperf3-srv_10.42.42.10(pid=29600): Launched 10:36:54.094878 tst iperf3m4.py:8: start network... 10:36:54.312628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:36:54.813752 run create_hlr_db(pid=29601): Launched 10:36:54.937491 bus /gobi_6: Setting Powered False 10:36:56.001948 run create_hlr_db(pid=29601): Terminated: ok {rc=0} 10:36:56.453059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29603): Launched 10:36:56.777245 run osmo-hlr_10.42.42.2(pid=29604): Launched 10:36:56.901801 run osmo-stp_10.42.42.5: Starting osmo-stp 10:36:57.459601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29606): Launched 10:36:57.781274 run osmo-stp_10.42.42.5(pid=29607): Launched 10:36:57.904809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:36:58.460569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29609): Launched 10:36:58.585351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:36:58.856689 run patchelf(pid=29610): Launched 10:36:59.036471 run osmo-stp_10.42.42.5(pid=29607): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29607)] 10:36:59.173798 run osmo-stp_10.42.42.5(pid=29607): stdout: | (launched: 2022-12-10_10:36:57.723134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:59.312262 run osmo-stp_10.42.42.5(pid=29607): stderr: | 20221210103657914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103657914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103657915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103657915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103657915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103657916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103657916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:59.451026 run osmo-stp_10.42.42.5(pid=29607): stdout: | (launched: 2022-12-10_10:36:57.723134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:36:59.583793 run osmo-stp_10.42.42.5(pid=29607): stderr: | 20221210103657914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103657914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103657915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103657915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103657915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103657916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103657916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:36:59.740418 run patchelf(pid=29610): Terminating (SIGINT) 10:36:59.921675 run patchelf(pid=29610): Terminated: ok {rc=0} 10:37:00.052291 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29607): Process ended prematurely: osmo-stp_10.42.42.5(pid=29607) [trial-2373↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29607)] [trial-2373↪gprs:trx-lms↪iperf3m4.py:8] 10:37:00.062478 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:37:00.091965 run osmo-hlr_10.42.42.2(pid=29604): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29604)] 10:37:00.142432 run osmo-hlr_10.42.42.2(pid=29604): stdout: | (launched: 2022-12-10_10:36:56.718589) 10:37:00.194318 run osmo-hlr_10.42.42.2(pid=29604): stderr: | 20221210103656918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103656918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103656918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103656918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103656918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103656918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103656930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103656938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103656938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103656938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:00.246552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29593): Terminating (SIGTERM) 10:37:00.288366 run iperf3-srv_10.42.42.10(pid=29594): Terminating (SIGTERM) 10:37:00.330805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29595): Terminating (SIGTERM) 10:37:00.372995 run iperf3-srv_10.42.42.10(pid=29596): Terminating (SIGTERM) 10:37:00.415159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29597): Terminating (SIGTERM) 10:37:00.457488 run iperf3-srv_10.42.42.10(pid=29598): Terminating (SIGTERM) 10:37:00.499519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29599): Terminating (SIGTERM) 10:37:00.541937 run iperf3-srv_10.42.42.10(pid=29600): Terminating (SIGTERM) 10:37:00.584001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29603): Terminating (SIGTERM) 10:37:00.626250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29606): Terminating (SIGTERM) 10:37:00.668271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29609): Terminating (SIGTERM) 10:37:00.710697 --- ParallelTerminationStrategy: PID 29593 died... 10:37:00.730645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29593): Terminated: ok {rc=0} 10:37:00.777281 --- ParallelTerminationStrategy: PID 29594 died... 10:37:00.796719 run iperf3-srv_10.42.42.10(pid=29594): Terminated {rc=256} 10:37:00.844275 --- ParallelTerminationStrategy: PID 29595 died... 10:37:00.867510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29595): Terminated: ok {rc=0} 10:37:00.914629 --- ParallelTerminationStrategy: PID 29596 died... 10:37:00.934549 run iperf3-srv_10.42.42.10(pid=29596): Terminated {rc=256} 10:37:00.981735 --- ParallelTerminationStrategy: PID 29597 died... 10:37:01.001582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29597): Terminated: ok {rc=0} 10:37:01.048822 --- ParallelTerminationStrategy: PID 29598 died... 10:37:01.068879 run iperf3-srv_10.42.42.10(pid=29598): Terminated {rc=256} 10:37:01.116250 --- ParallelTerminationStrategy: PID 29599 died... 10:37:01.136298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29599): Terminated: ok {rc=0} 10:37:01.183329 --- ParallelTerminationStrategy: PID 29600 died... 10:37:01.203423 run iperf3-srv_10.42.42.10(pid=29600): Terminated {rc=256} 10:37:01.250834 --- ParallelTerminationStrategy: PID 29603 died... 10:37:01.271093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29603): Terminated: ok {rc=0} 10:37:01.318457 --- ParallelTerminationStrategy: PID 29606 died... 10:37:01.338678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29606): Terminated: ok {rc=0} 10:37:01.386317 --- ParallelTerminationStrategy: PID 29609 died... 10:37:01.406202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29609): Terminated: ok {rc=0} 10:37:01.495054 bus /gobi_4: Setting Powered False 10:37:02.596621 bus /gobi_4: Setting Powered False 10:37:03.711890 bus /gobi_1: Setting Powered False 10:37:04.810290 bus /gobi_1: Setting Powered False 10:37:05.925409 bus /gobi_0: Setting Powered False 10:37:07.023455 bus /gobi_0: Setting Powered False 10:37:08.140058 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms ping.py ---------------------------------------------- 10:37:09.242843 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.254755 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:37:09.306617 tst ping.py: using LAC 27806 10:37:09.431838 tst ping.py: using RAC 11 10:37:09.556459 tst ping.py: using CellId 27806 10:37:09.673715 tst ping.py: using BVCI 27807 10:37:09.780885 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.791638 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.802451 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.813181 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.824143 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.834711 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.845428 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:09.855988 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:37:09.972485 tst ping.py:19: start network... 10:37:10.186693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:10.678512 run create_hlr_db(pid=29611): Launched 10:37:10.799962 bus /gobi_6: Setting Powered False 10:37:11.862907 run create_hlr_db(pid=29611): Terminated: ok {rc=0} 10:37:12.289475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29613): Launched 10:37:12.588310 run osmo-hlr_10.42.42.2(pid=29614): Launched 10:37:12.702201 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:13.221349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29616): Launched 10:37:13.519217 run osmo-stp_10.42.42.5(pid=29617): Launched 10:37:13.633629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:14.147768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29619): Launched 10:37:14.263339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:14.513616 run patchelf(pid=29620): Launched 10:37:14.679846 run osmo-stp_10.42.42.5(pid=29617): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29617)] 10:37:14.805877 run osmo-stp_10.42.42.5(pid=29617): stdout: | (launched: 2022-12-10_10:37:13.464800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:14.933647 run osmo-stp_10.42.42.5(pid=29617): stderr: | 20221210103713635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103713635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103713636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103713636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103713636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103713637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103713637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:15.061682 run osmo-stp_10.42.42.5(pid=29617): stdout: | (launched: 2022-12-10_10:37:13.464800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:15.184056 run osmo-stp_10.42.42.5(pid=29617): stderr: | 20221210103713635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103713635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103713636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103713636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103713636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103713637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103713637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:15.329677 run patchelf(pid=29620): Terminating (SIGINT) 10:37:15.498168 run patchelf(pid=29620): Terminated: ok {rc=0} 10:37:15.619699 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29617): Process ended prematurely: osmo-stp_10.42.42.5(pid=29617) [trial-2373↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29617)] [trial-2373↪gprs:trx-lms↪ping.py:22] 10:37:15.628733 tst ping.py:22: Test FAILED (6.4 sec) 10:37:15.655588 run osmo-hlr_10.42.42.2(pid=29614): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29614)] 10:37:15.702919 run osmo-hlr_10.42.42.2(pid=29614): stdout: | (launched: 2022-12-10_10:37:12.533883) 10:37:15.751815 run osmo-hlr_10.42.42.2(pid=29614): stderr: | 20221210103712710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103712710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103712710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103712710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103712710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103712710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103712722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103712732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103712733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103712733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:15.801096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29613): Terminating (SIGTERM) 10:37:15.862793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29616): Terminating (SIGTERM) 10:37:15.914775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29619): Terminating (SIGTERM) 10:37:15.955566 --- ParallelTerminationStrategy: PID 29613 died... 10:37:15.979293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29613): Terminated: ok {rc=0} 10:37:16.028867 --- ParallelTerminationStrategy: PID 29616 died... 10:37:16.048582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29616): Terminated: ok {rc=0} 10:37:16.093888 --- ParallelTerminationStrategy: PID 29619 died... 10:37:16.113226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29619): Terminated: ok {rc=0} 10:37:16.198339 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 10:37:17.283114 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.294395 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 10:37:17.344099 tst ping_idle_ping.py: using LAC 27807 10:37:17.462685 tst ping_idle_ping.py: using RAC 12 10:37:17.582411 tst ping_idle_ping.py: using CellId 27807 10:37:17.699118 tst ping_idle_ping.py: using BVCI 27808 10:37:17.808511 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.819115 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.829583 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.839909 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.850525 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.860940 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.871427 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 10:37:17.881832 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 10:37:17.994689 tst ping_idle_ping.py:24: start network... 10:37:18.194391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:18.658753 run create_hlr_db(pid=29621): Launched 10:37:18.780897 bus /gobi_6: Setting Powered False 10:37:19.841122 run create_hlr_db(pid=29621): Terminated: ok {rc=0} 10:37:20.258685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Launched 10:37:20.559805 run osmo-hlr_10.42.42.2(pid=29624): Launched 10:37:20.673903 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:21.187270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Launched 10:37:21.485958 run osmo-stp_10.42.42.5(pid=29627): Launched 10:37:21.600785 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:22.115200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29629): Launched 10:37:22.229822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:22.481385 run patchelf(pid=29630): Launched 10:37:22.648599 run osmo-stp_10.42.42.5(pid=29627): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] 10:37:22.775413 run osmo-stp_10.42.42.5(pid=29627): stdout: | (launched: 2022-12-10_10:37:21.431206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:22.903784 run osmo-stp_10.42.42.5(pid=29627): stderr: | 20221210103721599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103721599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103721600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103721600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103721601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103721601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103721601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:23.032076 run osmo-stp_10.42.42.5(pid=29627): stdout: | (launched: 2022-12-10_10:37:21.431206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:23.154361 run osmo-stp_10.42.42.5(pid=29627): stderr: | 20221210103721599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103721599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103721600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103721600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103721601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103721601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103721601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:23.299359 run patchelf(pid=29630): Terminating (SIGINT) 10:37:23.467074 run patchelf(pid=29630): Terminated: ok {rc=0} 10:37:23.588241 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29627): Process ended prematurely: osmo-stp_10.42.42.5(pid=29627) [trial-2373↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] [trial-2373↪gprs:trx-lms↪ping_idle_ping.py:27] 10:37:23.597428 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 10:37:23.624384 run osmo-hlr_10.42.42.2(pid=29624): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29624)] 10:37:23.671716 run osmo-hlr_10.42.42.2(pid=29624): stdout: | (launched: 2022-12-10_10:37:20.504454) 10:37:23.720583 run osmo-hlr_10.42.42.2(pid=29624): stderr: | 20221210103720681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103720681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103720682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103720682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103720682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103720682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103720694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103720703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103720703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103720703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:23.770116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Terminating (SIGTERM) 10:37:23.810134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Terminating (SIGTERM) 10:37:23.850103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29629): Terminating (SIGTERM) 10:37:23.890293 --- ParallelTerminationStrategy: PID 29623 died... 10:37:23.909466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Terminated: ok {rc=0} 10:37:23.953317 --- ParallelTerminationStrategy: PID 29626 died... 10:37:23.972209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Terminated: ok {rc=0} 10:37:24.016041 --- ParallelTerminationStrategy: PID 29629 died... 10:37:24.034773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29629): Terminated: ok {rc=0} 10:37:24.120288 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 10:37:25.425132 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:37:25.432130 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:37:25.468039 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:37:25.507859 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:37:25.601536 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:37:25.636465 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:37:25.676746 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:37:26.265802 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:37:26.318934 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.330491 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:37:26.381110 tst cs_paging_gprs_active.py: using LAC 27808 10:37:26.510688 tst cs_paging_gprs_active.py: using RAC 13 10:37:26.640259 tst cs_paging_gprs_active.py: using CellId 27808 10:37:26.767472 tst cs_paging_gprs_active.py: using BVCI 27809 10:37:26.885319 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.896582 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.907669 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.919770 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.931785 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.943185 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.954800 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.966246 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:26.977826 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:27.095996 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:27.215809 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:37:27.435831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:27.762602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29634): Launched 10:37:28.045195 run iperf3-srv_10.42.42.10(pid=29635): Launched 10:37:28.167474 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:37:28.386960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:28.713533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29636): Launched 10:37:28.997602 run iperf3-srv_10.42.42.10(pid=29637): Launched 10:37:29.120599 tst cs_paging_gprs_active.py:38: start network... 10:37:29.340873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:29.846019 run create_hlr_db(pid=29638): Launched 10:37:29.969902 bus /gobi_6: Setting Powered False 10:37:31.070238 run create_hlr_db(pid=29638): Terminated: ok {rc=0} 10:37:31.560760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29640): Launched 10:37:31.883079 run osmo-hlr_10.42.42.2(pid=29641): Launched 10:37:32.147689 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:32.771499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29643): Launched 10:37:33.075177 run osmo-stp_10.42.42.5(pid=29644): Launched 10:37:33.191656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:33.716610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29646): Launched 10:37:33.833157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:34.088593 run patchelf(pid=29647): Launched 10:37:34.259513 run osmo-stp_10.42.42.5(pid=29644): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29644)] 10:37:34.389185 run osmo-stp_10.42.42.5(pid=29644): stdout: | (launched: 2022-12-10_10:37:33.019834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:34.519870 run osmo-stp_10.42.42.5(pid=29644): stderr: | 20221210103733190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103733190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103733190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103733191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103733191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103733191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103733191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:34.650739 run osmo-stp_10.42.42.5(pid=29644): stdout: | (launched: 2022-12-10_10:37:33.019834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:34.775674 run osmo-stp_10.42.42.5(pid=29644): stderr: | 20221210103733190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103733190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103733190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103733191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103733191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103733191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103733191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:34.923647 run patchelf(pid=29647): Terminating (SIGINT) 10:37:35.095001 run patchelf(pid=29647): Terminated: ok {rc=0} 10:37:35.218657 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29644): Process ended prematurely: osmo-stp_10.42.42.5(pid=29644) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29644)] [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:37:35.228100 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 10:37:35.255332 run osmo-hlr_10.42.42.2(pid=29641): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29641)] 10:37:35.303040 run osmo-hlr_10.42.42.2(pid=29641): stdout: | (launched: 2022-12-10_10:37:31.820577) 10:37:35.352407 run osmo-hlr_10.42.42.2(pid=29641): stderr: | 20221210103732164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103732164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103732164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103732164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103732164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103732164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103732180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103732189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103732189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103732189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:35.402174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29634): Terminating (SIGTERM) 10:37:35.442122 run iperf3-srv_10.42.42.10(pid=29635): Terminating (SIGTERM) 10:37:35.482089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29636): Terminating (SIGTERM) 10:37:35.522176 run iperf3-srv_10.42.42.10(pid=29637): Terminating (SIGTERM) 10:37:35.562062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29640): Terminating (SIGTERM) 10:37:35.601912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29643): Terminating (SIGTERM) 10:37:35.641795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29646): Terminating (SIGTERM) 10:37:35.682147 --- ParallelTerminationStrategy: PID 29634 died... 10:37:35.701319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29634): Terminated: ok {rc=0} 10:37:35.745529 --- ParallelTerminationStrategy: PID 29635 died... 10:37:35.764237 run iperf3-srv_10.42.42.10(pid=29635): Terminated {rc=256} 10:37:35.807957 --- ParallelTerminationStrategy: PID 29636 died... 10:37:35.826773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29636): Terminated: ok {rc=0} 10:37:35.870594 --- ParallelTerminationStrategy: PID 29637 died... 10:37:35.889250 run iperf3-srv_10.42.42.10(pid=29637): Terminated {rc=256} 10:37:35.933654 --- ParallelTerminationStrategy: PID 29640 died... 10:37:35.952137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29640): Terminated: ok {rc=0} 10:37:35.999934 --- ParallelTerminationStrategy: PID 29643 died... 10:37:36.019732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29643): Terminated: ok {rc=0} 10:37:36.066841 --- ParallelTerminationStrategy: PID 29646 died... 10:37:36.086630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29646): Terminated: ok {rc=0} 10:37:36.175112 bus /gobi_0: Setting Powered False 10:37:37.274265 bus /gobi_0: Setting Powered False 10:37:38.390425 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:37:39.540064 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:39.551941 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:37:39.604822 tst iperf3.py: using LAC 27809 10:37:39.732779 tst iperf3.py: using RAC 14 10:37:39.860436 tst iperf3.py: using CellId 27809 10:37:39.989641 tst iperf3.py: using BVCI 27810 10:37:40.100847 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.112055 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.123250 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.134305 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.144992 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.155759 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.169907 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.181372 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:40.193114 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:40.312787 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:37:40.531693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:40.855401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29649): Launched 10:37:41.137516 run iperf3-srv_10.42.42.10(pid=29650): Launched 10:37:41.259519 tst iperf3.py:8: start network... 10:37:41.478581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:41.981155 run create_hlr_db(pid=29651): Launched 10:37:42.105445 bus /gobi_6: Setting Powered False 10:37:43.169382 run create_hlr_db(pid=29651): Terminated: ok {rc=0} 10:37:43.607829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29653): Launched 10:37:43.912111 run osmo-hlr_10.42.42.2(pid=29654): Launched 10:37:44.028551 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:44.554153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29656): Launched 10:37:44.856296 run osmo-stp_10.42.42.5(pid=29657): Launched 10:37:44.971943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:45.493347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29659): Launched 10:37:45.609608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:45.864740 run patchelf(pid=29660): Launched 10:37:46.066184 run osmo-stp_10.42.42.5(pid=29657): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29657)] 10:37:46.196785 run osmo-stp_10.42.42.5(pid=29657): stdout: | (launched: 2022-12-10_10:37:44.801121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:46.329423 run osmo-stp_10.42.42.5(pid=29657): stderr: | 20221210103744973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103744973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103744974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103744974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103744975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103744975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103744975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:46.461752 run osmo-stp_10.42.42.5(pid=29657): stdout: | (launched: 2022-12-10_10:37:44.801121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:46.588748 run osmo-stp_10.42.42.5(pid=29657): stderr: | 20221210103744973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103744973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103744974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103744974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103744975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103744975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103744975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:46.737929 run patchelf(pid=29660): Terminating (SIGINT) 10:37:46.911275 run patchelf(pid=29660): Terminated: ok {rc=0} 10:37:47.036451 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29657): Process ended prematurely: osmo-stp_10.42.42.5(pid=29657) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29657)] [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 10:37:47.047163 tst iperf3.py:8: Test FAILED (7.5 sec) 10:37:47.075692 run osmo-hlr_10.42.42.2(pid=29654): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29654)] 10:37:47.123836 run osmo-hlr_10.42.42.2(pid=29654): stdout: | (launched: 2022-12-10_10:37:43.857072) 10:37:47.174319 run osmo-hlr_10.42.42.2(pid=29654): stderr: | 20221210103744035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103744035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103744035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103744036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103744036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103744036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103744052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103744062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103744062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103744062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:47.224308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29649): Terminating (SIGTERM) 10:37:47.264154 run iperf3-srv_10.42.42.10(pid=29650): Terminating (SIGTERM) 10:37:47.303818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29653): Terminating (SIGTERM) 10:37:47.343659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29656): Terminating (SIGTERM) 10:37:47.383485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29659): Terminating (SIGTERM) 10:37:47.423498 --- ParallelTerminationStrategy: PID 29649 died... 10:37:47.442499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29649): Terminated: ok {rc=0} 10:37:47.486683 --- ParallelTerminationStrategy: PID 29650 died... 10:37:47.505373 run iperf3-srv_10.42.42.10(pid=29650): Terminated {rc=256} 10:37:47.549312 --- ParallelTerminationStrategy: PID 29653 died... 10:37:47.567857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29653): Terminated: ok {rc=0} 10:37:47.612003 --- ParallelTerminationStrategy: PID 29656 died... 10:37:47.630605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29656): Terminated: ok {rc=0} 10:37:47.674676 --- ParallelTerminationStrategy: PID 29659 died... 10:37:47.693418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29659): Terminated: ok {rc=0} 10:37:47.777653 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:37:48.926275 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:48.938275 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:37:48.991025 tst iperf3m4.py: using LAC 27810 10:37:49.118591 tst iperf3m4.py: using RAC 15 10:37:49.244519 tst iperf3m4.py: using CellId 27810 10:37:49.370850 tst iperf3m4.py: using BVCI 27811 10:37:49.489897 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.501279 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.512329 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.523693 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.535173 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.546619 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.558050 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.570045 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:37:49.581833 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:49.701761 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:49.819914 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:49.939772 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:37:50.057837 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:37:50.262673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:50.568552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29661): Launched 10:37:50.834310 run iperf3-srv_10.42.42.10(pid=29662): Launched 10:37:50.948918 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:37:51.154380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:51.458705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29663): Launched 10:37:51.723365 run iperf3-srv_10.42.42.10(pid=29664): Launched 10:37:51.837625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:37:52.041527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:52.346781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Launched 10:37:52.612560 run iperf3-srv_10.42.42.10(pid=29666): Launched 10:37:52.726709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:37:52.929641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:37:53.234195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29667): Launched 10:37:53.499054 run iperf3-srv_10.42.42.10(pid=29668): Launched 10:37:53.613332 tst iperf3m4.py:8: start network... 10:37:53.816585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:37:54.286325 run create_hlr_db(pid=29669): Launched 10:37:54.411629 bus /gobi_6: Setting Powered False 10:37:55.472251 run create_hlr_db(pid=29669): Terminated: ok {rc=0} 10:37:55.916460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29671): Launched 10:37:56.241702 run osmo-hlr_10.42.42.2(pid=29672): Launched 10:37:56.366296 run osmo-stp_10.42.42.5: Starting osmo-stp 10:37:56.931934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29674): Launched 10:37:57.255389 run osmo-stp_10.42.42.5(pid=29675): Launched 10:37:57.378899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:37:57.938201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29677): Launched 10:37:58.063002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:37:58.335504 run patchelf(pid=29678): Launched 10:37:58.516175 run osmo-stp_10.42.42.5(pid=29675): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29675)] 10:37:58.654888 run osmo-stp_10.42.42.5(pid=29675): stdout: | (launched: 2022-12-10_10:37:57.196700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:58.794751 run osmo-stp_10.42.42.5(pid=29675): stderr: | 20221210103757388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103757388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103757388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103757389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103757389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103757389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103757389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:58.934225 run osmo-stp_10.42.42.5(pid=29675): stdout: | (launched: 2022-12-10_10:37:57.196700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:37:59.067375 run osmo-stp_10.42.42.5(pid=29675): stderr: | 20221210103757388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103757388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103757388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103757389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103757389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103757389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103757389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:37:59.225366 run patchelf(pid=29678): Terminating (SIGINT) 10:37:59.406870 run patchelf(pid=29678): Terminated: ok {rc=0} 10:37:59.530485 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29675): Process ended prematurely: osmo-stp_10.42.42.5(pid=29675) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29675)] [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 10:37:59.540037 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:37:59.567974 run osmo-hlr_10.42.42.2(pid=29672): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29672)] 10:37:59.615962 run osmo-hlr_10.42.42.2(pid=29672): stdout: | (launched: 2022-12-10_10:37:56.183086) 10:37:59.665512 run osmo-hlr_10.42.42.2(pid=29672): stderr: | 20221210103756382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103756382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103756382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103756382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103756382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103756382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103756395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103756403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103756403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103756403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:37:59.715316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29661): Terminating (SIGTERM) 10:37:59.754923 run iperf3-srv_10.42.42.10(pid=29662): Terminating (SIGTERM) 10:37:59.794730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29663): Terminating (SIGTERM) 10:37:59.834458 run iperf3-srv_10.42.42.10(pid=29664): Terminating (SIGTERM) 10:37:59.874120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Terminating (SIGTERM) 10:37:59.913681 run iperf3-srv_10.42.42.10(pid=29666): Terminating (SIGTERM) 10:37:59.953249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29667): Terminating (SIGTERM) 10:37:59.993719 run iperf3-srv_10.42.42.10(pid=29668): Terminating (SIGTERM) 10:38:00.033628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29671): Terminating (SIGTERM) 10:38:00.073421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29674): Terminating (SIGTERM) 10:38:00.113312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29677): Terminating (SIGTERM) 10:38:00.153466 --- ParallelTerminationStrategy: PID 29661 died... 10:38:00.172541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29661): Terminated: ok {rc=0} 10:38:00.216716 --- ParallelTerminationStrategy: PID 29662 died... 10:38:00.235552 run iperf3-srv_10.42.42.10(pid=29662): Terminated {rc=256} 10:38:00.279321 --- ParallelTerminationStrategy: PID 29663 died... 10:38:00.298135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29663): Terminated: ok {rc=0} 10:38:00.342277 --- ParallelTerminationStrategy: PID 29664 died... 10:38:00.361038 run iperf3-srv_10.42.42.10(pid=29664): Terminated {rc=256} 10:38:00.405024 --- ParallelTerminationStrategy: PID 29665 died... 10:38:00.423991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Terminated: ok {rc=0} 10:38:00.467679 --- ParallelTerminationStrategy: PID 29666 died... 10:38:00.486480 run iperf3-srv_10.42.42.10(pid=29666): Terminated {rc=256} 10:38:00.530282 --- ParallelTerminationStrategy: PID 29667 died... 10:38:00.549050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29667): Terminated: ok {rc=0} 10:38:00.593170 --- ParallelTerminationStrategy: PID 29668 died... 10:38:00.612001 run iperf3-srv_10.42.42.10(pid=29668): Terminated {rc=256} 10:38:00.656265 --- ParallelTerminationStrategy: PID 29671 died... 10:38:00.675087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29671): Terminated: ok {rc=0} 10:38:00.718635 --- ParallelTerminationStrategy: PID 29674 died... 10:38:00.737305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29674): Terminated: ok {rc=0} 10:38:00.781225 --- ParallelTerminationStrategy: PID 29677 died... 10:38:00.799584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29677): Terminated: ok {rc=0} 10:38:00.890017 bus /gobi_4: Setting Powered False 10:38:01.985192 bus /gobi_4: Setting Powered False 10:38:03.099532 bus /gobi_1: Setting Powered False 10:38:04.197535 bus /gobi_1: Setting Powered False 10:38:05.313337 bus /gobi_0: Setting Powered False 10:38:06.411426 bus /gobi_0: Setting Powered False 10:38:07.528333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 10:38:08.632202 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:08.644378 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:38:08.697304 tst ping.py: using LAC 27811 10:38:08.822103 tst ping.py: using RAC 16 10:38:08.946561 tst ping.py: using CellId 27811 10:38:09.070871 tst ping.py: using BVCI 27812 10:38:09.188008 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:09.199342 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:09.210607 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:09.221864 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:09.233141 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:09.244289 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:09.255864 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:09.267168 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:09.382649 tst ping.py:19: start network... 10:38:09.582539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:10.043448 run create_hlr_db(pid=29679): Launched 10:38:10.165431 bus /gobi_6: Setting Powered False 10:38:11.225721 run create_hlr_db(pid=29679): Terminated: ok {rc=0} 10:38:11.661054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29681): Launched 10:38:11.978409 run osmo-hlr_10.42.42.2(pid=29682): Launched 10:38:12.099974 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:12.652650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29684): Launched 10:38:12.969601 run osmo-stp_10.42.42.5(pid=29685): Launched 10:38:13.093100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:13.643801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29687): Launched 10:38:13.766065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:14.033093 run patchelf(pid=29688): Launched 10:38:14.209847 run osmo-stp_10.42.42.5(pid=29685): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29685)] 10:38:14.344191 run osmo-stp_10.42.42.5(pid=29685): stdout: | (launched: 2022-12-10_10:38:12.912066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:14.480615 run osmo-stp_10.42.42.5(pid=29685): stderr: | 20221210103813105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103813105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103813106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103813106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103813106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103813107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103813107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:14.617961 run osmo-stp_10.42.42.5(pid=29685): stdout: | (launched: 2022-12-10_10:38:12.912066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:14.748779 run osmo-stp_10.42.42.5(pid=29685): stderr: | 20221210103813105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103813105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103813106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103813106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103813106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103813107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103813107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:14.903237 run patchelf(pid=29688): Terminating (SIGINT) 10:38:15.081240 run patchelf(pid=29688): Terminated: ok {rc=0} 10:38:15.209954 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29685): Process ended prematurely: osmo-stp_10.42.42.5(pid=29685) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29685)] [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 10:38:15.219480 tst ping.py:22: Test FAILED (6.6 sec) 10:38:15.248242 run osmo-hlr_10.42.42.2(pid=29682): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29682)] 10:38:15.298413 run osmo-hlr_10.42.42.2(pid=29682): stdout: | (launched: 2022-12-10_10:38:11.921273) 10:38:15.350397 run osmo-hlr_10.42.42.2(pid=29682): stderr: | 20221210103812118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103812118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103812118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103812118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103812118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103812118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103812132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103812141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103812141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103812141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:15.402588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29681): Terminating (SIGTERM) 10:38:15.444386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29684): Terminating (SIGTERM) 10:38:15.486302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29687): Terminating (SIGTERM) 10:38:15.528517 --- ParallelTerminationStrategy: PID 29681 died... 10:38:15.548692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29681): Terminated: ok {rc=0} 10:38:15.595334 --- ParallelTerminationStrategy: PID 29684 died... 10:38:15.614870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29684): Terminated: ok {rc=0} 10:38:15.661188 --- ParallelTerminationStrategy: PID 29687 died... 10:38:15.680648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29687): Terminated: ok {rc=0} 10:38:15.769157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:38:16.866538 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:16.883418 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:38:16.957662 tst ping_idle_ping.py: using LAC 27812 10:38:17.111578 tst ping_idle_ping.py: using RAC 17 10:38:17.240797 tst ping_idle_ping.py: using CellId 27812 10:38:17.362317 tst ping_idle_ping.py: using BVCI 27813 10:38:17.485311 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:17.500105 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:17.513731 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:17.531375 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:17.542888 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:17.555736 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:17.568630 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:38:17.580559 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:38:17.704672 tst ping_idle_ping.py:24: start network... 10:38:17.933494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:18.509916 run create_hlr_db(pid=29839): Launched 10:38:18.707227 bus /gobi_6: Setting Powered False 10:38:19.773794 run create_hlr_db(pid=29839): Terminated: ok {rc=0} 10:38:20.272918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29961): Launched 10:38:20.619165 run osmo-hlr_10.42.42.2(pid=29962): Launched 10:38:20.866706 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:21.504456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29966): Launched 10:38:21.832415 run osmo-stp_10.42.42.5(pid=29967): Launched 10:38:22.068167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:22.783422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29969): Launched 10:38:22.918030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:23.197858 run patchelf(pid=29970): Launched 10:38:23.391315 run osmo-stp_10.42.42.5(pid=29967): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29967)] 10:38:23.530197 run osmo-stp_10.42.42.5(pid=29967): stdout: | (launched: 2022-12-10_10:38:21.769552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:23.672765 run osmo-stp_10.42.42.5(pid=29967): stderr: | 20221210103822099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103822099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103822099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103822100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103822100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103822100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103822100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:23.814894 run osmo-stp_10.42.42.5(pid=29967): stdout: | (launched: 2022-12-10_10:38:21.769552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:23.949532 run osmo-stp_10.42.42.5(pid=29967): stderr: | 20221210103822099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103822099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103822099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103822100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103822100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103822100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103822100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:24.110268 run patchelf(pid=29970): Terminating (SIGINT) 10:38:24.294204 run patchelf(pid=29970): Terminated: ok {rc=0} 10:38:24.429057 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29967): Process ended prematurely: osmo-stp_10.42.42.5(pid=29967) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29967)] [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 10:38:24.439702 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 10:38:24.472424 run osmo-hlr_10.42.42.2(pid=29962): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29962)] 10:38:24.525495 run osmo-hlr_10.42.42.2(pid=29962): stdout: | (launched: 2022-12-10_10:38:20.551673) 10:38:24.581173 run osmo-hlr_10.42.42.2(pid=29962): stderr: | 20221210103820872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103820872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103820872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103820872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103820872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103820873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103820886 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103820894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103820895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103820895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:24.636242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29961): Terminating (SIGTERM) 10:38:24.682241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29966): Terminating (SIGTERM) 10:38:24.729886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29969): Terminating (SIGTERM) 10:38:24.778478 --- ParallelTerminationStrategy: PID 29961 died... 10:38:24.799770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29961): Terminated: ok {rc=0} 10:38:24.851541 --- ParallelTerminationStrategy: PID 29966 died... 10:38:24.872549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29966): Terminated: ok {rc=0} 10:38:24.923117 --- ParallelTerminationStrategy: PID 29969 died... 10:38:24.943941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29969): Terminated: ok {rc=0} 10:38:25.039795 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:38:26.352468 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:38:26.359945 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:38:26.399089 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:38:26.441763 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:38:26.532660 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:38:26.570682 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:38:26.613112 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:38:27.205628 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:38:27.262714 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.275132 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:38:27.349709 tst cs_paging_gprs_active.py: using LAC 27813 10:38:27.482005 tst cs_paging_gprs_active.py: using RAC 18 10:38:27.613615 tst cs_paging_gprs_active.py: using CellId 27813 10:38:27.747959 tst cs_paging_gprs_active.py: using BVCI 27814 10:38:27.870714 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.883298 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.895586 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.907928 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.920321 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.936002 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.949863 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.963688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:27.977916 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:28.104772 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:28.231535 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:38:28.459368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:28.809728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Launched 10:38:29.117715 run iperf3-srv_10.42.42.10(pid=29975): Launched 10:38:29.255194 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:38:29.482177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:29.826956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29976): Launched 10:38:30.136411 run iperf3-srv_10.42.42.10(pid=29977): Launched 10:38:30.275941 tst cs_paging_gprs_active.py:38: start network... 10:38:30.503021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:31.064192 run create_hlr_db(pid=29978): Launched 10:38:31.228875 bus /gobi_6: Setting Powered False 10:38:32.337433 run create_hlr_db(pid=29978): Terminated: ok {rc=0} 10:38:32.816300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29980): Launched 10:38:33.143504 run osmo-hlr_10.42.42.2(pid=29981): Launched 10:38:33.377849 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:34.032257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29983): Launched 10:38:34.382979 run osmo-stp_10.42.42.5(pid=29984): Launched 10:38:34.636456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:35.301313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29986): Launched 10:38:35.442438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:35.749790 run patchelf(pid=29987): Launched 10:38:35.947829 run osmo-stp_10.42.42.5(pid=29984): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29984)] 10:38:36.094321 run osmo-stp_10.42.42.5(pid=29984): stdout: | (launched: 2022-12-10_10:38:34.316639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:36.239747 run osmo-stp_10.42.42.5(pid=29984): stderr: | 20221210103834618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103834618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103834619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103834619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103834630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103834630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103834630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:36.386593 run osmo-stp_10.42.42.5(pid=29984): stdout: | (launched: 2022-12-10_10:38:34.316639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:36.525792 run osmo-stp_10.42.42.5(pid=29984): stderr: | 20221210103834618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103834618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103834619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103834619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103834630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103834630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103834630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:36.692479 run patchelf(pid=29987): Terminating (SIGINT) 10:38:36.884233 run patchelf(pid=29987): Terminated: ok {rc=0} 10:38:37.023931 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29984): Process ended prematurely: osmo-stp_10.42.42.5(pid=29984) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29984)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:38:37.035369 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 10:38:37.068719 run osmo-hlr_10.42.42.2(pid=29981): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29981)] 10:38:37.123244 run osmo-hlr_10.42.42.2(pid=29981): stdout: | (launched: 2022-12-10_10:38:33.081269) 10:38:37.179312 run osmo-hlr_10.42.42.2(pid=29981): stderr: | 20221210103833332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103833332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103833332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103833332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103833332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103833332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103833365 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103833390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103833390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103833390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:37.234742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Terminating (SIGTERM) 10:38:37.280097 run iperf3-srv_10.42.42.10(pid=29975): Terminating (SIGTERM) 10:38:37.327856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29976): Terminating (SIGTERM) 10:38:37.375823 run iperf3-srv_10.42.42.10(pid=29977): Terminating (SIGTERM) 10:38:37.423743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29980): Terminating (SIGTERM) 10:38:37.469652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29983): Terminating (SIGTERM) 10:38:37.517439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29986): Terminating (SIGTERM) 10:38:37.566660 --- ParallelTerminationStrategy: PID 29974 died... 10:38:37.588842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Terminated: ok {rc=0} 10:38:37.640772 --- ParallelTerminationStrategy: PID 29975 died... 10:38:37.662149 run iperf3-srv_10.42.42.10(pid=29975): Terminated {rc=256} 10:38:37.712831 --- ParallelTerminationStrategy: PID 29976 died... 10:38:37.735268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29976): Terminated: ok {rc=0} 10:38:37.786991 --- ParallelTerminationStrategy: PID 29977 died... 10:38:37.807854 run iperf3-srv_10.42.42.10(pid=29977): Terminated {rc=256} 10:38:37.858875 --- ParallelTerminationStrategy: PID 29980 died... 10:38:37.879649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29980): Terminated: ok {rc=0} 10:38:37.929327 --- ParallelTerminationStrategy: PID 29983 died... 10:38:37.950715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29983): Terminated: ok {rc=0} 10:38:38.003025 --- ParallelTerminationStrategy: PID 29986 died... 10:38:38.024164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29986): Terminated: ok {rc=0} 10:38:38.118348 bus /gobi_0: Setting Powered False 10:38:39.223450 bus /gobi_0: Setting Powered False 10:38:40.343872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:38:41.490322 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:41.501833 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:38:41.572155 tst iperf3.py: using LAC 27814 10:38:41.691187 tst iperf3.py: using RAC 19 10:38:41.811912 tst iperf3.py: using CellId 27814 10:38:41.932145 tst iperf3.py: using BVCI 27815 10:38:42.043744 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.054612 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.065203 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.075793 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.086457 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.097136 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.107825 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.118382 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:42.129112 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:42.246550 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:38:42.450957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:42.755496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29989): Launched 10:38:43.021219 run iperf3-srv_10.42.42.10(pid=29990): Launched 10:38:43.135681 tst iperf3.py:8: start network... 10:38:43.339441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:43.809192 run create_hlr_db(pid=29991): Launched 10:38:43.933449 bus /gobi_6: Setting Powered False 10:38:44.995059 run create_hlr_db(pid=29991): Terminated: ok {rc=0} 10:38:45.436442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29993): Launched 10:38:45.761449 run osmo-hlr_10.42.42.2(pid=29994): Launched 10:38:45.965931 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:46.674995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29996): Launched 10:38:47.002725 run osmo-stp_10.42.42.5(pid=29997): Launched 10:38:47.255393 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:38:47.818430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29999): Launched 10:38:47.943351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:38:48.216395 run patchelf(pid=30000): Launched 10:38:48.397960 run osmo-stp_10.42.42.5(pid=29997): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29997)] 10:38:48.535849 run osmo-stp_10.42.42.5(pid=29997): stdout: | (launched: 2022-12-10_10:38:46.937294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:48.675497 run osmo-stp_10.42.42.5(pid=29997): stderr: | 20221210103847235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103847235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103847235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103847235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103847236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103847236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103847236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:48.815149 run osmo-stp_10.42.42.5(pid=29997): stdout: | (launched: 2022-12-10_10:38:46.937294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:38:48.947923 run osmo-stp_10.42.42.5(pid=29997): stderr: | 20221210103847235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103847235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103847235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103847235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103847236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103847236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103847236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:38:49.106057 run patchelf(pid=30000): Terminating (SIGINT) 10:38:49.288156 run patchelf(pid=30000): Terminated: ok {rc=0} 10:38:49.420010 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29997): Process ended prematurely: osmo-stp_10.42.42.5(pid=29997) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29997)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 10:38:49.430077 tst iperf3.py:8: Test FAILED (8.0 sec) 10:38:49.459302 run osmo-hlr_10.42.42.2(pid=29994): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29994)] 10:38:49.509733 run osmo-hlr_10.42.42.2(pid=29994): stdout: | (launched: 2022-12-10_10:38:45.702937) 10:38:49.562224 run osmo-hlr_10.42.42.2(pid=29994): stderr: | 20221210103845963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103845963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103845963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103845963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103845963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103845963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103845980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103845992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103845992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103845993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:38:49.614896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29989): Terminating (SIGTERM) 10:38:49.657047 run iperf3-srv_10.42.42.10(pid=29990): Terminating (SIGTERM) 10:38:49.699262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29993): Terminating (SIGTERM) 10:38:49.741645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29996): Terminating (SIGTERM) 10:38:49.783608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29999): Terminating (SIGTERM) 10:38:49.826134 --- ParallelTerminationStrategy: PID 29989 died... 10:38:49.846235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29989): Terminated: ok {rc=0} 10:38:49.893165 --- ParallelTerminationStrategy: PID 29990 died... 10:38:49.912681 run iperf3-srv_10.42.42.10(pid=29990): Terminated {rc=256} 10:38:49.959234 --- ParallelTerminationStrategy: PID 29993 died... 10:38:49.978909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29993): Terminated: ok {rc=0} 10:38:50.025506 --- ParallelTerminationStrategy: PID 29996 died... 10:38:50.045137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29996): Terminated: ok {rc=0} 10:38:50.091640 --- ParallelTerminationStrategy: PID 29999 died... 10:38:50.111678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29999): Terminated: ok {rc=0} 10:38:50.200501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:38:51.352149 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:51.364418 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:38:51.438300 tst iperf3m4.py: using LAC 27815 10:38:51.566988 tst iperf3m4.py: using RAC 20 10:38:51.695888 tst iperf3m4.py: using CellId 27815 10:38:51.822611 tst iperf3m4.py: using BVCI 27816 10:38:51.940719 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:51.952243 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:51.963521 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:51.975121 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:51.986567 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:51.998118 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:52.009672 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:52.021314 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:38:52.033430 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:52.149801 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:52.273820 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:52.392188 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:38:52.508476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:38:52.713632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:53.019284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30001): Launched 10:38:53.285332 run iperf3-srv_10.42.42.10(pid=30002): Launched 10:38:53.399614 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:38:53.603130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:53.907590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30003): Launched 10:38:54.172624 run iperf3-srv_10.42.42.10(pid=30004): Launched 10:38:54.286667 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:38:54.489569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:54.793649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Launched 10:38:55.060476 run iperf3-srv_10.42.42.10(pid=30006): Launched 10:38:55.174470 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:38:55.377401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:38:55.681465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30007): Launched 10:38:55.946358 run iperf3-srv_10.42.42.10(pid=30008): Launched 10:38:56.060174 tst iperf3m4.py:8: start network... 10:38:56.263692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:38:56.734183 run create_hlr_db(pid=30009): Launched 10:38:56.859738 bus /gobi_6: Setting Powered False 10:38:57.919889 run create_hlr_db(pid=30009): Terminated: ok {rc=0} 10:38:58.342950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30011): Launched 10:38:58.646414 run osmo-hlr_10.42.42.2(pid=30012): Launched 10:38:58.761356 run osmo-stp_10.42.42.5: Starting osmo-stp 10:38:59.283427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30014): Launched 10:38:59.587018 run osmo-stp_10.42.42.5(pid=30015): Launched 10:38:59.703272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:00.226682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30017): Launched 10:39:00.342663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:00.598273 run patchelf(pid=30018): Launched 10:39:00.767388 run osmo-stp_10.42.42.5(pid=30015): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30015)] 10:39:00.896745 run osmo-stp_10.42.42.5(pid=30015): stdout: | (launched: 2022-12-10_10:38:59.531261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:01.028691 run osmo-stp_10.42.42.5(pid=30015): stderr: | 20221210103859701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103859701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103859701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103859702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103859702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103859702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103859702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:01.161872 run osmo-stp_10.42.42.5(pid=30015): stdout: | (launched: 2022-12-10_10:38:59.531261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:01.288750 run osmo-stp_10.42.42.5(pid=30015): stderr: | 20221210103859701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103859701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103859701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103859702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103859702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103859702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103859702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:01.439190 run patchelf(pid=30018): Terminating (SIGINT) 10:39:01.613627 run patchelf(pid=30018): Terminated: ok {rc=0} 10:39:01.739235 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30015): Process ended prematurely: osmo-stp_10.42.42.5(pid=30015) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30015)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:39:01.749300 tst iperf3m4.py:8: Test FAILED (10.4 sec) 10:39:01.778045 run osmo-hlr_10.42.42.2(pid=30012): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30012)] 10:39:01.826945 run osmo-hlr_10.42.42.2(pid=30012): stdout: | (launched: 2022-12-10_10:38:58.590926) 10:39:01.877871 run osmo-hlr_10.42.42.2(pid=30012): stderr: | 20221210103858770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103858770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103858770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103858770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103858770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103858770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103858782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103858793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103858794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103858794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:01.928825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30001): Terminating (SIGTERM) 10:39:01.969758 run iperf3-srv_10.42.42.10(pid=30002): Terminating (SIGTERM) 10:39:02.011987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30003): Terminating (SIGTERM) 10:39:02.053249 run iperf3-srv_10.42.42.10(pid=30004): Terminating (SIGTERM) 10:39:02.093833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Terminating (SIGTERM) 10:39:02.134509 run iperf3-srv_10.42.42.10(pid=30006): Terminating (SIGTERM) 10:39:02.174831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30007): Terminating (SIGTERM) 10:39:02.215242 run iperf3-srv_10.42.42.10(pid=30008): Terminating (SIGTERM) 10:39:02.255526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30011): Terminating (SIGTERM) 10:39:02.295446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30014): Terminating (SIGTERM) 10:39:02.335219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30017): Terminating (SIGTERM) 10:39:02.375413 --- ParallelTerminationStrategy: PID 30001 died... 10:39:02.394560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30001): Terminated: ok {rc=0} 10:39:02.438763 --- ParallelTerminationStrategy: PID 30002 died... 10:39:02.457547 run iperf3-srv_10.42.42.10(pid=30002): Terminated {rc=256} 10:39:02.501717 --- ParallelTerminationStrategy: PID 30003 died... 10:39:02.520352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30003): Terminated: ok {rc=0} 10:39:02.564566 --- ParallelTerminationStrategy: PID 30004 died... 10:39:02.583277 run iperf3-srv_10.42.42.10(pid=30004): Terminated {rc=256} 10:39:02.627333 --- ParallelTerminationStrategy: PID 30005 died... 10:39:02.646002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Terminated: ok {rc=0} 10:39:02.690180 --- ParallelTerminationStrategy: PID 30006 died... 10:39:02.709200 run iperf3-srv_10.42.42.10(pid=30006): Terminated {rc=256} 10:39:02.753323 --- ParallelTerminationStrategy: PID 30007 died... 10:39:02.772022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30007): Terminated: ok {rc=0} 10:39:02.816076 --- ParallelTerminationStrategy: PID 30008 died... 10:39:02.835025 run iperf3-srv_10.42.42.10(pid=30008): Terminated {rc=256} 10:39:02.879189 --- ParallelTerminationStrategy: PID 30011 died... 10:39:02.897914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30011): Terminated: ok {rc=0} 10:39:02.942083 --- ParallelTerminationStrategy: PID 30014 died... 10:39:02.960865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30014): Terminated: ok {rc=0} 10:39:03.005253 --- ParallelTerminationStrategy: PID 30017 died... 10:39:03.024002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30017): Terminated: ok {rc=0} 10:39:03.110302 bus /gobi_4: Setting Powered False 10:39:04.210650 bus /gobi_4: Setting Powered False 10:39:05.323956 bus /gobi_1: Setting Powered False 10:39:06.423560 bus /gobi_1: Setting Powered False 10:39:07.544179 bus /gobi_0: Setting Powered False 10:39:08.642948 bus /gobi_0: Setting Powered False 10:39:09.761238 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:39:10.862026 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:10.873513 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:39:10.943657 tst ping.py: using LAC 27816 10:39:11.059734 tst ping.py: using RAC 21 10:39:11.176601 tst ping.py: using CellId 27816 10:39:11.292820 tst ping.py: using BVCI 27817 10:39:11.401415 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:11.412172 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:11.422805 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:11.433432 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:11.443953 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:11.454725 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:11.465492 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:11.476072 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:11.594238 tst ping.py:19: start network... 10:39:11.808122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:12.300381 run create_hlr_db(pid=30020): Launched 10:39:12.422418 bus /gobi_6: Setting Powered False 10:39:13.485437 run create_hlr_db(pid=30020): Terminated: ok {rc=0} 10:39:13.913116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30022): Launched 10:39:14.211313 run osmo-hlr_10.42.42.2(pid=30023): Launched 10:39:14.326008 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:14.841732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30025): Launched 10:39:15.139108 run osmo-stp_10.42.42.5(pid=30026): Launched 10:39:15.254445 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:15.768797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30028): Launched 10:39:15.884222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:16.155637 run patchelf(pid=30029): Launched 10:39:16.344655 run osmo-stp_10.42.42.5(pid=30026): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30026)] 10:39:16.485119 run osmo-stp_10.42.42.5(pid=30026): stdout: | (launched: 2022-12-10_10:39:15.084579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:16.627749 run osmo-stp_10.42.42.5(pid=30026): stderr: | 20221210103915255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103915256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103915256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103915256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103915257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103915257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103915257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:16.770604 run osmo-stp_10.42.42.5(pid=30026): stdout: | (launched: 2022-12-10_10:39:15.084579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:16.905174 run osmo-stp_10.42.42.5(pid=30026): stderr: | 20221210103915255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103915256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103915256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103915256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103915257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103915257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103915257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:17.065844 run patchelf(pid=30029): Terminating (SIGINT) 10:39:17.249604 run patchelf(pid=30029): Terminated: ok {rc=0} 10:39:17.379893 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30026): Process ended prematurely: osmo-stp_10.42.42.5(pid=30026) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30026)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 10:39:17.389831 tst ping.py:22: Test FAILED (6.5 sec) 10:39:17.420642 run osmo-hlr_10.42.42.2(pid=30023): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30023)] 10:39:17.472299 run osmo-hlr_10.42.42.2(pid=30023): stdout: | (launched: 2022-12-10_10:39:14.156738) 10:39:17.525950 run osmo-hlr_10.42.42.2(pid=30023): stderr: | 20221210103914333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103914333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103914333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103914333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103914333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103914333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103914346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103914355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103914355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103914355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:17.579964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30022): Terminating (SIGTERM) 10:39:17.623150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30025): Terminating (SIGTERM) 10:39:17.666406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30028): Terminating (SIGTERM) 10:39:17.709833 --- ParallelTerminationStrategy: PID 30022 died... 10:39:17.730161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30022): Terminated: ok {rc=0} 10:39:17.778867 --- ParallelTerminationStrategy: PID 30025 died... 10:39:17.798722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30025): Terminated: ok {rc=0} 10:39:17.847135 --- ParallelTerminationStrategy: PID 30028 died... 10:39:17.867067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30028): Terminated: ok {rc=0} 10:39:17.957458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:39:19.046327 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.058343 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:39:19.129978 tst ping_idle_ping.py: using LAC 27817 10:39:19.249633 tst ping_idle_ping.py: using RAC 22 10:39:19.366855 tst ping_idle_ping.py: using CellId 27817 10:39:19.486172 tst ping_idle_ping.py: using BVCI 27818 10:39:19.596005 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.607213 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.617969 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.628648 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.639413 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.650180 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.660933 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:39:19.671662 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:39:19.789186 tst ping_idle_ping.py:24: start network... 10:39:20.006059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:20.503565 run create_hlr_db(pid=30030): Launched 10:39:20.627027 bus /gobi_6: Setting Powered False 10:39:21.690217 run create_hlr_db(pid=30030): Terminated: ok {rc=0} 10:39:22.136350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30032): Launched 10:39:22.455155 run osmo-hlr_10.42.42.2(pid=30033): Launched 10:39:22.577957 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:23.130316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30035): Launched 10:39:23.451154 run osmo-stp_10.42.42.5(pid=30036): Launched 10:39:23.574190 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:24.125998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30038): Launched 10:39:24.249487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:24.518526 run patchelf(pid=30039): Launched 10:39:24.697346 run osmo-stp_10.42.42.5(pid=30036): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30036)] 10:39:24.832765 run osmo-stp_10.42.42.5(pid=30036): stdout: | (launched: 2022-12-10_10:39:23.393273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:24.970095 run osmo-stp_10.42.42.5(pid=30036): stderr: | 20221210103923585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103923585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103923585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103923586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103923586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103923586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103923586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:25.107563 run osmo-stp_10.42.42.5(pid=30036): stdout: | (launched: 2022-12-10_10:39:23.393273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:25.238501 run osmo-stp_10.42.42.5(pid=30036): stderr: | 20221210103923585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103923585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103923585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103923586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103923586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103923586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103923586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:25.394136 run patchelf(pid=30039): Terminating (SIGINT) 10:39:25.573245 run patchelf(pid=30039): Terminated: ok {rc=0} 10:39:25.702251 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30036): Process ended prematurely: osmo-stp_10.42.42.5(pid=30036) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30036)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:39:25.711651 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:39:25.740515 run osmo-hlr_10.42.42.2(pid=30033): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30033)] 10:39:25.790919 run osmo-hlr_10.42.42.2(pid=30033): stdout: | (launched: 2022-12-10_10:39:22.397435) 10:39:25.843499 run osmo-hlr_10.42.42.2(pid=30033): stderr: | 20221210103922594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103922594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103922594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103922594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103922594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103922594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103922609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103922619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103922619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103922619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:25.896095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30032): Terminating (SIGTERM) 10:39:25.938614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30035): Terminating (SIGTERM) 10:39:25.981152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30038): Terminating (SIGTERM) 10:39:26.024033 --- ParallelTerminationStrategy: PID 30032 died... 10:39:26.044335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30032): Terminated: ok {rc=0} 10:39:26.091747 --- ParallelTerminationStrategy: PID 30035 died... 10:39:26.111581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30035): Terminated: ok {rc=0} 10:39:26.158677 --- ParallelTerminationStrategy: PID 30038 died... 10:39:26.178497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30038): Terminated: ok {rc=0} 10:39:26.268258 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:39:27.578312 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:39:27.585886 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:39:27.619569 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:39:27.658010 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:39:27.745102 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:39:27.777831 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:39:27.816064 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:39:28.411138 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:39:28.460320 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:28.471384 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:39:28.540144 tst cs_paging_gprs_active.py: using LAC 27818 10:39:28.659196 tst cs_paging_gprs_active.py: using RAC 23 10:39:28.778690 tst cs_paging_gprs_active.py: using CellId 27818 10:39:28.897249 tst cs_paging_gprs_active.py: using BVCI 27819 10:39:29.007560 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.018435 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.029123 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.039725 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.050470 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.061450 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.072194 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.082979 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:29.093829 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:29.213488 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:29.338464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:39:29.559277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:29.887375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30043): Launched 10:39:30.171611 run iperf3-srv_10.42.42.10(pid=30044): Launched 10:39:30.295243 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:39:30.515689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:30.847482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30045): Launched 10:39:31.152117 run iperf3-srv_10.42.42.10(pid=30046): Launched 10:39:31.305893 tst cs_paging_gprs_active.py:38: start network... 10:39:31.530121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:32.078338 run create_hlr_db(pid=30047): Launched 10:39:32.237337 bus /gobi_6: Setting Powered False 10:39:33.298416 run create_hlr_db(pid=30047): Terminated: ok {rc=0} 10:39:33.745908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30049): Launched 10:39:34.071280 run osmo-hlr_10.42.42.2(pid=30050): Launched 10:39:34.196625 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:34.759820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30052): Launched 10:39:35.084519 run osmo-stp_10.42.42.5(pid=30053): Launched 10:39:35.208684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:35.770243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30055): Launched 10:39:35.895503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:36.170469 run patchelf(pid=30056): Launched 10:39:36.354119 run osmo-stp_10.42.42.5(pid=30053): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30053)] 10:39:36.491919 run osmo-stp_10.42.42.5(pid=30053): stdout: | (launched: 2022-12-10_10:39:35.025697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:36.632193 run osmo-stp_10.42.42.5(pid=30053): stderr: | 20221210103935218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103935218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103935219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103935219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103935219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103935219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103935219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:36.771821 run osmo-stp_10.42.42.5(pid=30053): stdout: | (launched: 2022-12-10_10:39:35.025697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:36.905702 run osmo-stp_10.42.42.5(pid=30053): stderr: | 20221210103935218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103935218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103935219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103935219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103935219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103935219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103935219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:37.063772 run patchelf(pid=30056): Terminating (SIGINT) 10:39:37.246880 run patchelf(pid=30056): Terminated: ok {rc=0} 10:39:37.378799 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30053): Process ended prematurely: osmo-stp_10.42.42.5(pid=30053) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30053)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:39:37.388848 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 10:39:37.418282 run osmo-hlr_10.42.42.2(pid=30050): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30050)] 10:39:37.468734 run osmo-hlr_10.42.42.2(pid=30050): stdout: | (launched: 2022-12-10_10:39:34.012529) 10:39:37.521105 run osmo-hlr_10.42.42.2(pid=30050): stderr: | 20221210103934212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103934212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103934212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103934212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103934212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103934212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103934224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103934232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103934233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103934233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:37.573666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30043): Terminating (SIGTERM) 10:39:37.616335 run iperf3-srv_10.42.42.10(pid=30044): Terminating (SIGTERM) 10:39:37.658728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30045): Terminating (SIGTERM) 10:39:37.701078 run iperf3-srv_10.42.42.10(pid=30046): Terminating (SIGTERM) 10:39:37.743157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30049): Terminating (SIGTERM) 10:39:37.785265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30052): Terminating (SIGTERM) 10:39:37.827542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30055): Terminating (SIGTERM) 10:39:37.869951 --- ParallelTerminationStrategy: PID 30043 died... 10:39:37.889938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30043): Terminated: ok {rc=0} 10:39:37.936664 --- ParallelTerminationStrategy: PID 30044 died... 10:39:37.956340 run iperf3-srv_10.42.42.10(pid=30044): Terminated {rc=256} 10:39:38.002785 --- ParallelTerminationStrategy: PID 30045 died... 10:39:38.022531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30045): Terminated: ok {rc=0} 10:39:38.069066 --- ParallelTerminationStrategy: PID 30046 died... 10:39:38.088661 run iperf3-srv_10.42.42.10(pid=30046): Terminated {rc=256} 10:39:38.135031 --- ParallelTerminationStrategy: PID 30049 died... 10:39:38.154634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30049): Terminated: ok {rc=0} 10:39:38.201254 --- ParallelTerminationStrategy: PID 30052 died... 10:39:38.220557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30052): Terminated: ok {rc=0} 10:39:38.267223 --- ParallelTerminationStrategy: PID 30055 died... 10:39:38.286954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30055): Terminated: ok {rc=0} 10:39:38.375338 bus /gobi_0: Setting Powered False 10:39:39.475299 bus /gobi_0: Setting Powered False 10:39:40.591707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:39:41.742452 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:41.754471 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:39:41.826707 tst iperf3.py: using LAC 27819 10:39:41.955116 tst iperf3.py: using RAC 24 10:39:42.077265 tst iperf3.py: using CellId 27819 10:39:42.197092 tst iperf3.py: using BVCI 27820 10:39:42.307414 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.318520 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.329502 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.340489 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.351449 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.362316 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.373219 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.384000 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:42.394971 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:42.513230 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:39:42.718649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:43.023958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Launched 10:39:43.289994 run iperf3-srv_10.42.42.10(pid=30058): Launched 10:39:43.404458 tst iperf3.py:8: start network... 10:39:43.608660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:44.080511 run create_hlr_db(pid=30059): Launched 10:39:44.205723 bus /gobi_6: Setting Powered False 10:39:45.270257 run create_hlr_db(pid=30059): Terminated: ok {rc=0} 10:39:45.722750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30061): Launched 10:39:46.073727 run osmo-hlr_10.42.42.2(pid=30062): Launched 10:39:46.218064 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:46.931524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30064): Launched 10:39:47.355712 run osmo-stp_10.42.42.5(pid=30065): Launched 10:39:47.546205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:39:48.112358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30067): Launched 10:39:48.237975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:39:48.512037 run patchelf(pid=30068): Launched 10:39:48.693913 run osmo-stp_10.42.42.5(pid=30065): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30065)] 10:39:48.832055 run osmo-stp_10.42.42.5(pid=30065): stdout: | (launched: 2022-12-10_10:39:47.291085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:48.971531 run osmo-stp_10.42.42.5(pid=30065): stderr: | 20221210103947555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103947555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103947555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103947556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103947556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103947556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103947556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:49.111254 run osmo-stp_10.42.42.5(pid=30065): stdout: | (launched: 2022-12-10_10:39:47.291085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:39:49.244341 run osmo-stp_10.42.42.5(pid=30065): stderr: | 20221210103947555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210103947555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210103947555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210103947556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210103947556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210103947556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210103947556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:39:49.402177 run patchelf(pid=30068): Terminating (SIGINT) 10:39:49.585249 run patchelf(pid=30068): Terminated: ok {rc=0} 10:39:49.716855 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30065): Process ended prematurely: osmo-stp_10.42.42.5(pid=30065) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30065)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 10:39:49.727017 tst iperf3.py:8: Test FAILED (8.0 sec) 10:39:49.756497 run osmo-hlr_10.42.42.2(pid=30062): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30062)] 10:39:49.806927 run osmo-hlr_10.42.42.2(pid=30062): stdout: | (launched: 2022-12-10_10:39:46.003568) 10:39:49.859069 run osmo-hlr_10.42.42.2(pid=30062): stderr: | 20221210103946451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103946451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103946451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103946451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103946452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103946452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103946470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103946484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103946484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103946484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:39:49.911763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Terminating (SIGTERM) 10:39:49.953992 run iperf3-srv_10.42.42.10(pid=30058): Terminating (SIGTERM) 10:39:49.996300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30061): Terminating (SIGTERM) 10:39:50.038757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30064): Terminating (SIGTERM) 10:39:50.081065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30067): Terminating (SIGTERM) 10:39:50.123737 --- ParallelTerminationStrategy: PID 30057 died... 10:39:50.143908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Terminated: ok {rc=0} 10:39:50.191144 --- ParallelTerminationStrategy: PID 30058 died... 10:39:50.210693 run iperf3-srv_10.42.42.10(pid=30058): Terminated {rc=256} 10:39:50.257434 --- ParallelTerminationStrategy: PID 30061 died... 10:39:50.277156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30061): Terminated: ok {rc=0} 10:39:50.323987 --- ParallelTerminationStrategy: PID 30064 died... 10:39:50.343762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30064): Terminated: ok {rc=0} 10:39:50.390572 --- ParallelTerminationStrategy: PID 30067 died... 10:39:50.410306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30067): Terminated: ok {rc=0} 10:39:50.498130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:39:51.648513 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:51.660546 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:39:51.734406 tst iperf3m4.py: using LAC 27820 10:39:51.861619 tst iperf3m4.py: using RAC 25 10:39:51.988158 tst iperf3m4.py: using CellId 27820 10:39:52.115013 tst iperf3m4.py: using BVCI 27821 10:39:52.232873 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.244319 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.255472 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.266886 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.278313 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.289731 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.301279 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.312459 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:39:52.323956 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:52.444151 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:52.563173 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:52.680407 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:39:52.803530 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:39:53.022531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:53.347984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30069): Launched 10:39:53.631321 run iperf3-srv_10.42.42.10(pid=30070): Launched 10:39:53.753701 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:39:53.972383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:54.297886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30071): Launched 10:39:54.581039 run iperf3-srv_10.42.42.10(pid=30072): Launched 10:39:54.703264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:39:54.921793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:55.247140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30073): Launched 10:39:55.529700 run iperf3-srv_10.42.42.10(pid=30074): Launched 10:39:55.652260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:39:55.871591 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:39:56.198618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30075): Launched 10:39:56.481101 run iperf3-srv_10.42.42.10(pid=30076): Launched 10:39:56.603177 tst iperf3m4.py:8: start network... 10:39:56.821499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:39:57.323687 run create_hlr_db(pid=30077): Launched 10:39:57.447568 bus /gobi_6: Setting Powered False 10:39:58.512033 run create_hlr_db(pid=30077): Terminated: ok {rc=0} 10:39:58.963969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Launched 10:39:59.287566 run osmo-hlr_10.42.42.2(pid=30080): Launched 10:39:59.412141 run osmo-stp_10.42.42.5: Starting osmo-stp 10:39:59.976006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Launched 10:40:00.299571 run osmo-stp_10.42.42.5(pid=30083): Launched 10:40:00.423865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:01.007352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Launched 10:40:01.140906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:01.434340 run patchelf(pid=30089): Launched 10:40:01.672270 run osmo-stp_10.42.42.5(pid=30083): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] 10:40:01.831563 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-10_10:40:00.240780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:01.974331 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221210104000435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104000435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104000435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104000435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104000436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104000436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104000436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:02.117482 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-10_10:40:00.240780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:02.253935 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221210104000435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104000435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104000435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104000435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104000436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104000436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104000436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:02.415161 run patchelf(pid=30089): Terminating (SIGINT) 10:40:02.597209 run patchelf(pid=30089): Terminated: ok {rc=0} 10:40:02.728552 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:40:02.738968 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:40:02.768682 run osmo-hlr_10.42.42.2(pid=30080): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30080)] 10:40:02.819314 run osmo-hlr_10.42.42.2(pid=30080): stdout: | (launched: 2022-12-10_10:39:59.228779) 10:40:02.871682 run osmo-hlr_10.42.42.2(pid=30080): stderr: | 20221210103959427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210103959427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210103959428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210103959428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210103959428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210103959428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210103959440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210103959448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210103959448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210103959448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:02.924412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30069): Terminating (SIGTERM) 10:40:02.967057 run iperf3-srv_10.42.42.10(pid=30070): Terminating (SIGTERM) 10:40:03.009909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30071): Terminating (SIGTERM) 10:40:03.052614 run iperf3-srv_10.42.42.10(pid=30072): Terminating (SIGTERM) 10:40:03.095207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30073): Terminating (SIGTERM) 10:40:03.137747 run iperf3-srv_10.42.42.10(pid=30074): Terminating (SIGTERM) 10:40:03.180229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30075): Terminating (SIGTERM) 10:40:03.222910 run iperf3-srv_10.42.42.10(pid=30076): Terminating (SIGTERM) 10:40:03.265425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminating (SIGTERM) 10:40:03.307678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminating (SIGTERM) 10:40:03.349939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Terminating (SIGTERM) 10:40:03.392841 --- ParallelTerminationStrategy: PID 30069 died... 10:40:03.413271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30069): Terminated: ok {rc=0} 10:40:03.460841 --- ParallelTerminationStrategy: PID 30070 died... 10:40:03.480475 run iperf3-srv_10.42.42.10(pid=30070): Terminated {rc=256} 10:40:03.527624 --- ParallelTerminationStrategy: PID 30071 died... 10:40:03.547532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30071): Terminated: ok {rc=0} 10:40:03.595456 --- ParallelTerminationStrategy: PID 30072 died... 10:40:03.615176 run iperf3-srv_10.42.42.10(pid=30072): Terminated {rc=256} 10:40:03.662112 --- ParallelTerminationStrategy: PID 30073 died... 10:40:03.681835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30073): Terminated: ok {rc=0} 10:40:03.728748 --- ParallelTerminationStrategy: PID 30074 died... 10:40:03.748467 run iperf3-srv_10.42.42.10(pid=30074): Terminated {rc=256} 10:40:03.795255 --- ParallelTerminationStrategy: PID 30075 died... 10:40:03.814956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30075): Terminated: ok {rc=0} 10:40:03.862112 --- ParallelTerminationStrategy: PID 30076 died... 10:40:03.881905 run iperf3-srv_10.42.42.10(pid=30076): Terminated {rc=256} 10:40:03.928857 --- ParallelTerminationStrategy: PID 30079 died... 10:40:03.949183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminated: ok {rc=0} 10:40:03.996341 --- ParallelTerminationStrategy: PID 30082 died... 10:40:04.016206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminated: ok {rc=0} 10:40:04.063557 --- ParallelTerminationStrategy: PID 30085 died... 10:40:04.083463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Terminated: ok {rc=0} 10:40:04.173300 bus /gobi_4: Setting Powered False 10:40:05.272889 bus /gobi_4: Setting Powered False 10:40:06.390639 bus /gobi_1: Setting Powered False 10:40:07.490095 bus /gobi_1: Setting Powered False 10:40:08.606033 bus /gobi_0: Setting Powered False 10:40:09.705851 bus /gobi_0: Setting Powered False 10:40:10.821580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:40:11.924827 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:11.936223 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:12.006836 tst ping.py: using LAC 27821 10:40:12.127375 tst ping.py: using RAC 26 10:40:12.244438 tst ping.py: using CellId 27821 10:40:12.361087 tst ping.py: using BVCI 27822 10:40:12.469337 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:12.480214 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:12.490974 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:12.501771 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:12.512414 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:12.523218 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:12.534080 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:12.544779 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:12.660201 tst ping.py:19: start network... 10:40:12.861981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:13.326230 run create_hlr_db(pid=30090): Launched 10:40:13.447751 bus /gobi_6: Setting Powered False 10:40:14.511222 run create_hlr_db(pid=30090): Terminated: ok {rc=0} 10:40:14.954608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30092): Launched 10:40:15.273705 run osmo-hlr_10.42.42.2(pid=30093): Launched 10:40:15.395571 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:15.977867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30095): Launched 10:40:16.301892 run osmo-stp_10.42.42.5(pid=30096): Launched 10:40:16.458107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:17.143350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30098): Launched 10:40:17.275161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:17.531380 run patchelf(pid=30099): Launched 10:40:17.699715 run osmo-stp_10.42.42.5(pid=30096): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30096)] 10:40:17.827548 run osmo-stp_10.42.42.5(pid=30096): stdout: | (launched: 2022-12-10_10:40:16.240665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:17.956579 run osmo-stp_10.42.42.5(pid=30096): stderr: | 20221210104016602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104016602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104016602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104016602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104016604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104016607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104016607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:18.085713 run osmo-stp_10.42.42.5(pid=30096): stdout: | (launched: 2022-12-10_10:40:16.240665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:18.208639 run osmo-stp_10.42.42.5(pid=30096): stderr: | 20221210104016602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104016602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104016602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104016602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104016604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104016607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104016607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:18.354547 run patchelf(pid=30099): Terminating (SIGINT) 10:40:18.523239 run patchelf(pid=30099): Terminated: ok {rc=0} 10:40:18.644878 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30096): Process ended prematurely: osmo-stp_10.42.42.5(pid=30096) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30096)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 10:40:18.653950 tst ping.py:22: Test FAILED (6.7 sec) 10:40:18.681062 run osmo-hlr_10.42.42.2(pid=30093): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30093)] 10:40:18.729056 run osmo-hlr_10.42.42.2(pid=30093): stdout: | (launched: 2022-12-10_10:40:15.215909) 10:40:18.778499 run osmo-hlr_10.42.42.2(pid=30093): stderr: | 20221210104015415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104015415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104015415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104015415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104015415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104015415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104015427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104015435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104015435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104015435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:18.828724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30092): Terminating (SIGTERM) 10:40:18.869064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30095): Terminating (SIGTERM) 10:40:18.909411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30098): Terminating (SIGTERM) 10:40:18.950138 --- ParallelTerminationStrategy: PID 30092 died... 10:40:18.969524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30092): Terminated: ok {rc=0} 10:40:19.014234 --- ParallelTerminationStrategy: PID 30095 died... 10:40:19.033237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30095): Terminated: ok {rc=0} 10:40:19.077709 --- ParallelTerminationStrategy: PID 30098 died... 10:40:19.096506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30098): Terminated: ok {rc=0} 10:40:19.183201 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:40:20.271798 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.283660 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:40:20.356057 tst ping_idle_ping.py: using LAC 27822 10:40:20.475103 tst ping_idle_ping.py: using RAC 27 10:40:20.593152 tst ping_idle_ping.py: using CellId 27822 10:40:20.710717 tst ping_idle_ping.py: using BVCI 27823 10:40:20.820522 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.831748 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.842839 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.854043 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.865077 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.875976 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.887301 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:40:20.898532 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:40:21.015810 tst ping_idle_ping.py:24: start network... 10:40:21.232311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:21.730809 run create_hlr_db(pid=30100): Launched 10:40:21.854141 bus /gobi_6: Setting Powered False 10:40:22.917932 run create_hlr_db(pid=30100): Terminated: ok {rc=0} 10:40:23.363532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30102): Launched 10:40:23.683217 run osmo-hlr_10.42.42.2(pid=30103): Launched 10:40:23.806279 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:24.360103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30105): Launched 10:40:24.680707 run osmo-stp_10.42.42.5(pid=30106): Launched 10:40:24.803213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:25.354297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30108): Launched 10:40:25.478174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:25.747901 run patchelf(pid=30109): Launched 10:40:25.925947 run osmo-stp_10.42.42.5(pid=30106): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30106)] 10:40:26.061768 run osmo-stp_10.42.42.5(pid=30106): stdout: | (launched: 2022-12-10_10:40:24.622564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:26.198894 run osmo-stp_10.42.42.5(pid=30106): stderr: | 20221210104024814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104024814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104024814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104024815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104024815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104024815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104024815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:26.336097 run osmo-stp_10.42.42.5(pid=30106): stdout: | (launched: 2022-12-10_10:40:24.622564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:26.467068 run osmo-stp_10.42.42.5(pid=30106): stderr: | 20221210104024814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104024814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104024814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104024815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104024815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104024815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104024815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:26.622343 run patchelf(pid=30109): Terminating (SIGINT) 10:40:26.801066 run patchelf(pid=30109): Terminated: ok {rc=0} 10:40:26.929938 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30106): Process ended prematurely: osmo-stp_10.42.42.5(pid=30106) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30106)] [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:40:26.939510 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:40:26.968485 run osmo-hlr_10.42.42.2(pid=30103): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30103)] 10:40:27.018893 run osmo-hlr_10.42.42.2(pid=30103): stdout: | (launched: 2022-12-10_10:40:23.624921) 10:40:27.071099 run osmo-hlr_10.42.42.2(pid=30103): stderr: | 20221210104023822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104023822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104023822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104023822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104023822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104023822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104023834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104023842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104023843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104023843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:27.123674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30102): Terminating (SIGTERM) 10:40:27.166082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30105): Terminating (SIGTERM) 10:40:27.208551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30108): Terminating (SIGTERM) 10:40:27.251269 --- ParallelTerminationStrategy: PID 30102 died... 10:40:27.271532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30102): Terminated: ok {rc=0} 10:40:27.319187 --- ParallelTerminationStrategy: PID 30105 died... 10:40:27.339001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30105): Terminated: ok {rc=0} 10:40:27.385970 --- ParallelTerminationStrategy: PID 30108 died... 10:40:27.405853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30108): Terminated: ok {rc=0} 10:40:27.494749 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:40:28.807810 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:28.814949 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:40:28.849520 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:40:28.885165 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:40:28.937353 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:40:28.971122 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:40:29.006572 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:40:29.567906 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:40:29.573234 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:29.584818 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:40:29.655305 tst switch_tch_pdch.py: using LAC 27823 10:40:29.778728 tst switch_tch_pdch.py: using RAC 28 10:40:29.901386 tst switch_tch_pdch.py: using CellId 27823 10:40:30.026629 tst switch_tch_pdch.py: using BVCI 27824 10:40:30.144343 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:30.156034 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:30.167447 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:30.179146 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:30.190824 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:30.202485 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:30.214453 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:40:30.226133 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:40:30.342029 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:40:30.462944 tst switch_tch_pdch.py:51: start network... 10:40:30.663484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:31.138737 run create_hlr_db(pid=30115): Launched 10:40:31.294610 bus /gobi_6: Setting Powered False 10:40:32.360361 run create_hlr_db(pid=30115): Terminated: ok {rc=0} 10:40:32.790923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30117): Launched 10:40:33.090017 run osmo-hlr_10.42.42.2(pid=30118): Launched 10:40:33.203200 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:33.728656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30120): Launched 10:40:34.027549 run osmo-stp_10.42.42.5(pid=30121): Launched 10:40:34.142030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:34.657066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30123): Launched 10:40:34.772632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:35.023381 run patchelf(pid=30124): Launched 10:40:35.189191 run osmo-stp_10.42.42.5(pid=30121): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30121)] 10:40:35.315061 run osmo-stp_10.42.42.5(pid=30121): stdout: | (launched: 2022-12-10_10:40:33.973372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:35.442969 run osmo-stp_10.42.42.5(pid=30121): stderr: | 20221210104034141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104034141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104034141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104034142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104034144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104034144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104034144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:35.570805 run osmo-stp_10.42.42.5(pid=30121): stdout: | (launched: 2022-12-10_10:40:33.973372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:35.692326 run osmo-stp_10.42.42.5(pid=30121): stderr: | 20221210104034141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104034141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104034141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104034142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104034144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104034144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104034144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:35.837182 run patchelf(pid=30124): Terminating (SIGINT) 10:40:36.005155 run patchelf(pid=30124): Terminated: ok {rc=0} 10:40:36.126252 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30121): Process ended prematurely: osmo-stp_10.42.42.5(pid=30121) [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30121)] [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:40:36.134906 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:40:36.161928 run osmo-hlr_10.42.42.2(pid=30118): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30118)] 10:40:36.209321 run osmo-hlr_10.42.42.2(pid=30118): stdout: | (launched: 2022-12-10_10:40:33.035984) 10:40:36.258357 run osmo-hlr_10.42.42.2(pid=30118): stderr: | 20221210104033213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104033213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104033213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104033213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104033213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104033213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104033225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104033234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104033234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104033234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:36.307984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30117): Terminating (SIGTERM) 10:40:36.347785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30120): Terminating (SIGTERM) 10:40:36.387717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30123): Terminating (SIGTERM) 10:40:36.427755 --- ParallelTerminationStrategy: PID 30117 died... 10:40:36.446978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30117): Terminated: ok {rc=0} 10:40:36.491212 --- ParallelTerminationStrategy: PID 30120 died... 10:40:36.509970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30120): Terminated: ok {rc=0} 10:40:36.553691 --- ParallelTerminationStrategy: PID 30123 died... 10:40:36.572214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30123): Terminated: ok {rc=0} 10:40:36.657594 bus /gobi_0: Setting Powered False 10:40:37.757512 bus /gobi_0: Setting Powered False 10:40:38.872709 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:40:40.124792 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:40.130494 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:40:40.163503 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:40:40.197972 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:40:40.250942 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:40:40.283489 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:40:40.317797 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:40:40.873804 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:40:40.878931 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:40.890096 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:40:40.959378 tst switch_tch_pdch.py: using LAC 27824 10:40:41.075883 tst switch_tch_pdch.py: using RAC 29 10:40:41.194291 tst switch_tch_pdch.py: using CellId 27824 10:40:41.313452 tst switch_tch_pdch.py: using BVCI 27825 10:40:41.421566 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:41.432384 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:41.443038 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:41.453714 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:41.464325 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:41.475092 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:41.485890 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:40:41.496435 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:40:41.612095 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:40:41.727076 tst switch_tch_pdch.py:51: start network... 10:40:41.958037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:40:42.424590 run create_hlr_db(pid=30128): Launched 10:40:42.546825 bus /gobi_6: Setting Powered False 10:40:43.610777 run create_hlr_db(pid=30128): Terminated: ok {rc=0} 10:40:44.014411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30130): Launched 10:40:44.312293 run osmo-hlr_10.42.42.2(pid=30131): Launched 10:40:44.426817 run osmo-stp_10.42.42.5: Starting osmo-stp 10:40:44.915343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30133): Launched 10:40:45.215080 run osmo-stp_10.42.42.5(pid=30134): Launched 10:40:45.328293 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:40:45.817762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30136): Launched 10:40:45.958369 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:40:46.277804 run patchelf(pid=30137): Launched 10:40:46.452578 run osmo-stp_10.42.42.5(pid=30134): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30134)] 10:40:46.580796 run osmo-stp_10.42.42.5(pid=30134): stdout: | (launched: 2022-12-10_10:40:45.160546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:46.711554 run osmo-stp_10.42.42.5(pid=30134): stderr: | 20221210104045330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104045331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104045331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104045331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104045332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104045332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104045332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:46.842082 run osmo-stp_10.42.42.5(pid=30134): stdout: | (launched: 2022-12-10_10:40:45.160546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:40:46.966698 run osmo-stp_10.42.42.5(pid=30134): stderr: | 20221210104045330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104045331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104045331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104045331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104045332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104045332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104045332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:40:47.114525 run patchelf(pid=30137): Terminating (SIGINT) 10:40:47.286003 run patchelf(pid=30137): Terminated: ok {rc=0} 10:40:47.408472 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30134): Process ended prematurely: osmo-stp_10.42.42.5(pid=30134) [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30134)] [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:40:47.417466 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 10:40:47.444205 run osmo-hlr_10.42.42.2(pid=30131): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30131)] 10:40:47.491771 run osmo-hlr_10.42.42.2(pid=30131): stdout: | (launched: 2022-12-10_10:40:44.258047) 10:40:47.541131 run osmo-hlr_10.42.42.2(pid=30131): stderr: | 20221210104044435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104044435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104044435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104044435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104044435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104044435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104044451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104044461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104044462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104044462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:40:47.590954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30130): Terminating (SIGTERM) 10:40:47.630653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30133): Terminating (SIGTERM) 10:40:47.670130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30136): Terminating (SIGTERM) 10:40:47.709893 --- ParallelTerminationStrategy: PID 30130 died... 10:40:47.729186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30130): Terminated: ok {rc=0} 10:40:47.773399 --- ParallelTerminationStrategy: PID 30133 died... 10:40:47.791940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30133): Terminated: ok {rc=0} 10:40:47.836011 --- ParallelTerminationStrategy: PID 30136 died... 10:40:47.854708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30136): Terminated: ok {rc=0} 10:40:47.942023 bus /gobi_0: Setting Powered False 10:40:49.041213 bus /gobi_0: Setting Powered False 10:40:50.156490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:40:51.407386 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:51.411297 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:40:51.440535 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:40:51.447833 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:40:51.502348 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:40:51.534051 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:40:51.541214 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:40:52.074973 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:40:52.080402 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:40:52.091528 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:40:52.135523 tst mo_mt_sms.py: using LAC 27825 10:40:52.254641 tst mo_mt_sms.py: using RAC 30 10:40:52.372749 tst mo_mt_sms.py: using CellId 27825 10:40:52.499468 tst mo_mt_sms.py: using BVCI 27826 10:40:52.617518 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:40:52.731987 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:40:52.844533 tst mo_mt_sms.py:9: start nitb and bts... 10:40:53.045937 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:40:53.654935 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30142): Launched 10:40:53.953979 run osmo-nitb_10.42.42.2(pid=30143): Launched 10:40:54.121230 run osmo-nitb_10.42.42.2(pid=30143): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30143)] 10:40:54.255468 run osmo-nitb_10.42.42.2(pid=30143): stdout: | (launched: 2022-12-10_10:40:53.899368) 10:40:54.391111 run osmo-nitb_10.42.42.2(pid=30143): stderr: | (launched: 2022-12-10_10:40:53.943668) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:40:54.526774 run osmo-nitb_10.42.42.2(pid=30143): stdout: | (launched: 2022-12-10_10:40:53.899368) 10:40:54.656371 run osmo-nitb_10.42.42.2(pid=30143): stderr: | (launched: 2022-12-10_10:40:53.943668) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30143): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30143) [trial-2373↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30143)] 10:40:55.068428 tst osmo-nitb_10.42.42.2(pid=30143): stdout: | (launched: 2022-12-10_10:40:53.899368) 10:40:55.188697 tst osmo-nitb_10.42.42.2(pid=30143): stderr: | (launched: 2022-12-10_10:40:53.943668) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:40:55.330818 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30143): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30143) [trial-2373↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30143)] [trial-2373↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 10:40:55.339148 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:40:55.346024 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30142): Terminating (SIGTERM) 10:40:55.556059 --- ParallelTerminationStrategy: PID 30142 died... 10:40:55.576436 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30142): Terminated: ok {rc=0} 10:40:55.663957 bus /sierra_3: Setting Powered False 10:40:56.764439 bus /sierra_3: Setting Powered False 10:40:57.880556 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 10:40:59.073552 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:40:59.077681 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:40:59.106791 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:40:59.133780 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 10:40:59.186570 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:40:59.215977 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:40:59.242373 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 10:40:59.788818 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 10:40:59.793706 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:40:59.804401 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:40:59.847973 tst mo_mt_sms.py: using LAC 27826 10:40:59.964916 tst mo_mt_sms.py: using RAC 31 10:41:00.082436 tst mo_mt_sms.py: using CellId 27826 10:41:00.207248 tst mo_mt_sms.py: using BVCI 27827 10:41:00.322819 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:00.334273 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:00.345972 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:00.357498 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:00.368683 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:00.379952 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:41:00.494932 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 10:41:00.608473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:01.084418 run create_hlr_db(pid=30148): Launched 10:41:01.240456 bus /sierra_2: Setting Powered False 10:41:02.304551 run create_hlr_db(pid=30148): Terminated: ok {rc=0} 10:41:02.734164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30150): Launched 10:41:03.032197 run osmo-hlr_10.42.42.2(pid=30151): Launched 10:41:03.145299 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:03.673793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30153): Launched 10:41:03.972589 run osmo-stp_10.42.42.5(pid=30154): Launched 10:41:04.086906 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:04.629283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30156): Launched 10:41:04.927525 run osmo-msc_10.42.42.6(pid=30157): Launched 10:41:05.095208 run osmo-stp_10.42.42.5(pid=30154): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30154)] 10:41:05.221239 run osmo-stp_10.42.42.5(pid=30154): stdout: | (launched: 2022-12-10_10:41:03.917032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:05.347651 run osmo-stp_10.42.42.5(pid=30154): stderr: | 20221210104104089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104104089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104104090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104104090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104104090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104104091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104104091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:05.472139 run osmo-stp_10.42.42.5(pid=30154): stdout: | (launched: 2022-12-10_10:41:03.917032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:05.591204 run osmo-stp_10.42.42.5(pid=30154): stderr: | 20221210104104089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104104089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104104090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104104090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104104090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104104091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104104091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:05.733813 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30154): Process ended prematurely: osmo-stp_10.42.42.5(pid=30154) [trial-2373↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30154)] [trial-2373↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 10:41:05.741789 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 10:41:05.768213 run osmo-hlr_10.42.42.2(pid=30151): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30151)] 10:41:05.816294 run osmo-hlr_10.42.42.2(pid=30151): stdout: | (launched: 2022-12-10_10:41:02.977815) 10:41:05.866038 run osmo-hlr_10.42.42.2(pid=30151): stderr: | 20221210104103154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104103154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104103154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104103154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104103154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104103154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104103166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104103176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104103176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104103176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:05.935355 run osmo-msc_10.42.42.6(pid=30157): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30157)] 10:41:05.983418 run osmo-msc_10.42.42.6(pid=30157): stdout: | (launched: 2022-12-10_10:41:04.872828) 10:41:06.033145 run osmo-msc_10.42.42.6(pid=30157): stderr: | 20221210104105144 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104105144 DLGLOBAL DEBUG validating counter group 0x7f5402d42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104105144 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104105144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104105144 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104105145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104105146 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104105147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104105147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104105147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:06.083953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30150): Terminating (SIGTERM) 10:41:06.124237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30153): Terminating (SIGTERM) 10:41:06.164257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30156): Terminating (SIGTERM) 10:41:06.204649 --- ParallelTerminationStrategy: PID 30150 died... 10:41:06.223978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30150): Terminated: ok {rc=0} 10:41:06.268190 --- ParallelTerminationStrategy: PID 30153 died... 10:41:06.286962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30153): Terminated: ok {rc=0} 10:41:06.331238 --- ParallelTerminationStrategy: PID 30156 died... 10:41:06.350036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30156): Terminated: ok {rc=0} 10:41:06.435739 bus /sierra_3: Setting Powered False 10:41:07.536816 bus /sierra_3: Setting Powered False 10:41:08.653669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:41:09.880262 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:09.883853 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:41:09.913105 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 10:41:09.920152 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:41:09.956223 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:41:09.987360 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 10:41:09.994606 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:41:10.511696 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:41:10.516454 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 10:41:10.527535 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:41:10.570905 tst assert_extension.py: using LAC 27827 10:41:10.687781 tst assert_extension.py: using RAC 32 10:41:10.807732 tst assert_extension.py: using CellId 27827 10:41:10.935711 tst assert_extension.py: using BVCI 27828 10:41:11.045270 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:41:11.164068 tst assert_extension.py:10: start nitb and bts... 10:41:11.381003 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:41:12.034608 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30162): Launched 10:41:12.354557 run osmo-nitb_10.42.42.2(pid=30163): Launched 10:41:12.532552 run osmo-nitb_10.42.42.2(pid=30163): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30163)] 10:41:12.677135 run osmo-nitb_10.42.42.2(pid=30163): stdout: | (launched: 2022-12-10_10:41:12.296830) 10:41:12.822508 run osmo-nitb_10.42.42.2(pid=30163): stderr: | (launched: 2022-12-10_10:41:12.344320) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:41:12.967892 run osmo-nitb_10.42.42.2(pid=30163): stdout: | (launched: 2022-12-10_10:41:12.296830) 10:41:13.107461 run osmo-nitb_10.42.42.2(pid=30163): stderr: | (launched: 2022-12-10_10:41:12.344320) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30163): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30163) [trial-2373↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30163)] 10:41:13.475714 tst osmo-nitb_10.42.42.2(pid=30163): stdout: | (launched: 2022-12-10_10:41:12.296830) 10:41:13.609927 tst osmo-nitb_10.42.42.2(pid=30163): stderr: | (launched: 2022-12-10_10:41:12.344320) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:41:13.756178 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30163): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30163) [trial-2373↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30163)] [trial-2373↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 10:41:13.765143 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:41:13.772507 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30162): Terminating (SIGTERM) 10:41:13.982757 --- ParallelTerminationStrategy: PID 30162 died... 10:41:14.003885 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30162): Terminated: ok {rc=0} 10:41:14.087727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 10:41:15.261541 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:15.266157 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:41:15.298583 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:41:15.326861 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 10:41:15.362330 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:41:15.392552 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:41:15.421736 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 10:41:15.965516 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 10:41:15.973191 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:15.988616 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:41:16.040854 tst assert_extension.py: using LAC 27828 10:41:16.176588 tst assert_extension.py: using RAC 33 10:41:16.296098 tst assert_extension.py: using CellId 27828 10:41:16.424572 tst assert_extension.py: using BVCI 27829 10:41:16.543462 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:16.555371 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:16.567205 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:16.579860 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:16.593194 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:41:16.604829 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 10:41:16.741431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:17.255233 run create_hlr_db(pid=30167): Launched 10:41:17.381154 bus /sierra_2: Setting Powered False 10:41:18.444890 run create_hlr_db(pid=30167): Terminated: ok {rc=0} 10:41:18.873597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30169): Launched 10:41:19.175638 run osmo-hlr_10.42.42.2(pid=30170): Launched 10:41:19.289802 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:19.811649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30172): Launched 10:41:20.112000 run osmo-stp_10.42.42.5(pid=30173): Launched 10:41:20.227947 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:20.767575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30175): Launched 10:41:21.067682 run osmo-msc_10.42.42.6(pid=30176): Launched 10:41:21.235597 run osmo-stp_10.42.42.5(pid=30173): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30173)] 10:41:21.361419 run osmo-stp_10.42.42.5(pid=30173): stdout: | (launched: 2022-12-10_10:41:20.057140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:21.487896 run osmo-stp_10.42.42.5(pid=30173): stderr: | 20221210104120228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104120228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104120228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104120228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104120229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104120229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104120229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:21.612004 run osmo-stp_10.42.42.5(pid=30173): stdout: | (launched: 2022-12-10_10:41:20.057140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:21.730814 run osmo-stp_10.42.42.5(pid=30173): stderr: | 20221210104120228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104120228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104120228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104120228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104120229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104120229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104120229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:21.872762 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30173): Process ended prematurely: osmo-stp_10.42.42.5(pid=30173) [trial-2373↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30173)] [trial-2373↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 10:41:21.881065 tst assert_extension.py:17: Test FAILED (5.9 sec) 10:41:21.907439 run osmo-hlr_10.42.42.2(pid=30170): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30170)] 10:41:21.954690 run osmo-hlr_10.42.42.2(pid=30170): stdout: | (launched: 2022-12-10_10:41:19.119429) 10:41:22.004001 run osmo-hlr_10.42.42.2(pid=30170): stderr: | 20221210104119294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104119294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104119294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104119294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104119294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104119294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104119306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104119315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104119315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104119315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:22.072551 run osmo-msc_10.42.42.6(pid=30176): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30176)] 10:41:22.119964 run osmo-msc_10.42.42.6(pid=30176): stdout: | (launched: 2022-12-10_10:41:21.013058) 10:41:22.168865 run osmo-msc_10.42.42.6(pid=30176): stderr: | 20221210104121287 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104121287 DLGLOBAL DEBUG validating counter group 0x7f8d5aa28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104121287 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104121287 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104121287 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104121288 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104121289 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104121290 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104121290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104121290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:22.218848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30169): Terminating (SIGTERM) 10:41:22.258129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30172): Terminating (SIGTERM) 10:41:22.297672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30175): Terminating (SIGTERM) 10:41:22.337444 --- ParallelTerminationStrategy: PID 30169 died... 10:41:22.356468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30169): Terminated: ok {rc=0} 10:41:22.400799 --- ParallelTerminationStrategy: PID 30172 died... 10:41:22.419832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30172): Terminated: ok {rc=0} 10:41:22.463841 --- ParallelTerminationStrategy: PID 30175 died... 10:41:22.482588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30175): Terminated: ok {rc=0} 10:41:22.568088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:41:23.775938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:23.782794 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:41:23.812451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:41:23.839141 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:41:23.891797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:41:23.921913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:41:23.948429 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:41:24.501087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:41:24.550604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:24.562218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:41:24.628192 tst mo_mt_call.py: using LAC 27829 10:41:24.748365 tst mo_mt_call.py: using RAC 34 10:41:24.869043 tst mo_mt_call.py: using CellId 27829 10:41:24.988455 tst mo_mt_call.py: using BVCI 27830 10:41:25.099764 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:25.111163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:25.122382 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:25.133551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:25.144720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:25.155865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:25.275137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:25.393416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:25.867219 run create_hlr_db(pid=30181): Launched 10:41:25.991536 bus /sierra_2: Setting Powered False 10:41:27.051582 run create_hlr_db(pid=30181): Terminated: ok {rc=0} 10:41:27.495829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30183): Launched 10:41:27.822302 run osmo-hlr_10.42.42.2(pid=30184): Launched 10:41:27.946610 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:28.510814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30186): Launched 10:41:28.820410 run osmo-stp_10.42.42.5(pid=30187): Launched 10:41:28.935929 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:29.486913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30189): Launched 10:41:29.792026 run osmo-msc_10.42.42.6(pid=30190): Launched 10:41:29.962532 run osmo-stp_10.42.42.5(pid=30187): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30187)] 10:41:30.091120 run osmo-stp_10.42.42.5(pid=30187): stdout: | (launched: 2022-12-10_10:41:28.765122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:30.219594 run osmo-stp_10.42.42.5(pid=30187): stderr: | 20221210104128935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104128935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104128936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104128936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104128936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104128937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104128937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:30.347130 run osmo-stp_10.42.42.5(pid=30187): stdout: | (launched: 2022-12-10_10:41:28.765122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:30.467958 run osmo-stp_10.42.42.5(pid=30187): stderr: | 20221210104128935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104128935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104128936 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104128936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104128936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104128937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104128937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:30.612673 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30187): Process ended prematurely: osmo-stp_10.42.42.5(pid=30187) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30187)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:41:30.621642 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:41:30.648249 run osmo-hlr_10.42.42.2(pid=30184): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30184)] 10:41:30.696085 run osmo-hlr_10.42.42.2(pid=30184): stdout: | (launched: 2022-12-10_10:41:27.763481) 10:41:30.745383 run osmo-hlr_10.42.42.2(pid=30184): stderr: | 20221210104127959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104127959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104127959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104127959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104127959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104127959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104127973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104127983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104127983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104127983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:30.814249 run osmo-msc_10.42.42.6(pid=30190): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30190)] 10:41:30.896083 run osmo-msc_10.42.42.6(pid=30190): stdout: | (launched: 2022-12-10_10:41:29.736447) 10:41:30.946364 run osmo-msc_10.42.42.6(pid=30190): stderr: | 20221210104130008 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104130009 DLGLOBAL DEBUG validating counter group 0x7f6bff6d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104130009 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104130009 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104130009 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104130009 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104130011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104130012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104130012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104130013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:30.996716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30183): Terminating (SIGTERM) 10:41:31.038392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30186): Terminating (SIGTERM) 10:41:31.081087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30189): Terminating (SIGTERM) 10:41:31.123551 --- ParallelTerminationStrategy: PID 30183 died... 10:41:31.142882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30183): Terminated: ok {rc=0} 10:41:31.187758 --- ParallelTerminationStrategy: PID 30186 died... 10:41:31.207092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30186): Terminated: ok {rc=0} 10:41:31.252095 --- ParallelTerminationStrategy: PID 30189 died... 10:41:31.271588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30189): Terminated: ok {rc=0} 10:41:31.356487 bus /sierra_3: Setting Powered False 10:41:32.453917 bus /sierra_3: Setting Powered False 10:41:33.570383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:41:34.720933 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:34.733658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:41:34.802575 tst mo_mt_call_osmux.py: using LAC 27830 10:41:34.932566 tst mo_mt_call_osmux.py: using RAC 35 10:41:35.053366 tst mo_mt_call_osmux.py: using CellId 27830 10:41:35.174402 tst mo_mt_call_osmux.py: using BVCI 27831 10:41:35.286680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:35.298265 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:35.309667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:35.321249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:35.332829 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:41:35.344296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:35.462497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:41:35.582990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:36.088565 run create_hlr_db(pid=30192): Launched 10:41:36.213923 bus /sierra_2: Setting Powered False 10:41:37.278626 run create_hlr_db(pid=30192): Terminated: ok {rc=0} 10:41:37.714564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30194): Launched 10:41:38.019915 run osmo-hlr_10.42.42.2(pid=30195): Launched 10:41:38.136155 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:38.660252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30197): Launched 10:41:38.965023 run osmo-stp_10.42.42.5(pid=30198): Launched 10:41:39.081410 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:39.635641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30200): Launched 10:41:39.940325 run osmo-msc_10.42.42.6(pid=30201): Launched 10:41:40.112271 run osmo-stp_10.42.42.5(pid=30198): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30198)] 10:41:40.241100 run osmo-stp_10.42.42.5(pid=30198): stdout: | (launched: 2022-12-10_10:41:38.909411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:40.370225 run osmo-stp_10.42.42.5(pid=30198): stderr: | 20221210104139080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104139081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104139081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104139081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104139082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104139082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104139082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:40.497863 run osmo-stp_10.42.42.5(pid=30198): stdout: | (launched: 2022-12-10_10:41:38.909411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:40.619405 run osmo-stp_10.42.42.5(pid=30198): stderr: | 20221210104139080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104139081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104139081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104139081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104139082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104139082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104139082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:40.764882 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30198): Process ended prematurely: osmo-stp_10.42.42.5(pid=30198) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30198)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:41:40.773741 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 10:41:40.800553 run osmo-hlr_10.42.42.2(pid=30195): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30195)] 10:41:40.848524 run osmo-hlr_10.42.42.2(pid=30195): stdout: | (launched: 2022-12-10_10:41:37.964364) 10:41:40.897922 run osmo-hlr_10.42.42.2(pid=30195): stderr: | 20221210104138141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104138141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104138141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104138141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104138141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104138141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104138154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104138164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104138164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104138164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:40.966758 run osmo-msc_10.42.42.6(pid=30201): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30201)] 10:41:41.014181 run osmo-msc_10.42.42.6(pid=30201): stdout: | (launched: 2022-12-10_10:41:39.884851) 10:41:41.063096 run osmo-msc_10.42.42.6(pid=30201): stderr: | 20221210104140159 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104140160 DLGLOBAL DEBUG validating counter group 0x7fe3fc267c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104140160 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104140160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104140160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104140160 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104140162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104140163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104140163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104140163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:41.112574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30194): Terminating (SIGTERM) 10:41:41.152221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30197): Terminating (SIGTERM) 10:41:41.191877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30200): Terminating (SIGTERM) 10:41:41.231985 --- ParallelTerminationStrategy: PID 30194 died... 10:41:41.251184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30194): Terminated: ok {rc=0} 10:41:41.295731 --- ParallelTerminationStrategy: PID 30197 died... 10:41:41.314483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30197): Terminated: ok {rc=0} 10:41:41.358576 --- ParallelTerminationStrategy: PID 30200 died... 10:41:41.377360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30200): Terminated: ok {rc=0} 10:41:41.460807 bus /sierra_3: Setting Powered False 10:41:42.558949 bus /sierra_3: Setting Powered False 10:41:43.678435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:41:44.924371 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:41:44.930856 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:41:44.959967 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:41:44.986877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:41:45.043252 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:41:45.072425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:41:45.098996 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:41:45.648032 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:41:45.697272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:45.708595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:41:45.775710 tst mo_mt_call.py: using LAC 27831 10:41:45.903766 tst mo_mt_call.py: using RAC 36 10:41:46.028015 tst mo_mt_call.py: using CellId 27831 10:41:46.148900 tst mo_mt_call.py: using BVCI 27832 10:41:46.300680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:46.316335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:46.330576 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:46.345624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:46.360415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:46.375004 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:41:46.502149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:41:46.622310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:47.121329 run create_hlr_db(pid=30206): Launched 10:41:47.271658 bus /sierra_2: Setting Powered False 10:41:48.333181 run create_hlr_db(pid=30206): Terminated: ok {rc=0} 10:41:48.778955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30208): Launched 10:41:49.104468 run osmo-hlr_10.42.42.2(pid=30209): Launched 10:41:49.229663 run osmo-stp_10.42.42.5: Starting osmo-stp 10:41:49.793167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30211): Launched 10:41:50.117377 run osmo-stp_10.42.42.5(pid=30212): Launched 10:41:50.241681 run osmo-msc_10.42.42.6: Starting osmo-msc 10:41:50.830793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30214): Launched 10:41:51.156741 run osmo-msc_10.42.42.6(pid=30215): Launched 10:41:51.339253 run osmo-stp_10.42.42.5(pid=30212): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30212)] 10:41:51.476875 run osmo-stp_10.42.42.5(pid=30212): stdout: | (launched: 2022-12-10_10:41:50.058484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:51.615540 run osmo-stp_10.42.42.5(pid=30212): stderr: | 20221210104150250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104150251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104150251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104150251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104150252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104150252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104150252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:51.753228 run osmo-stp_10.42.42.5(pid=30212): stdout: | (launched: 2022-12-10_10:41:50.058484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:41:51.882700 run osmo-stp_10.42.42.5(pid=30212): stderr: | 20221210104150250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104150251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104150251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104150251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104150252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104150252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104150252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:41:52.038107 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30212): Process ended prematurely: osmo-stp_10.42.42.5(pid=30212) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30212)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:41:52.047653 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:41:52.076168 run osmo-hlr_10.42.42.2(pid=30209): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30209)] 10:41:52.126162 run osmo-hlr_10.42.42.2(pid=30209): stdout: | (launched: 2022-12-10_10:41:49.045631) 10:41:52.177857 run osmo-hlr_10.42.42.2(pid=30209): stderr: | 20221210104149246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104149246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104149246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104149246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104149246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104149246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104149258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104149266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104149266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104149266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:41:52.250141 run osmo-msc_10.42.42.6(pid=30215): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30215)] 10:41:52.300145 run osmo-msc_10.42.42.6(pid=30215): stdout: | (launched: 2022-12-10_10:41:51.097876) 10:41:52.351956 run osmo-msc_10.42.42.6(pid=30215): stderr: | 20221210104151419 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104151419 DLGLOBAL DEBUG validating counter group 0x7f3501fbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104151419 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104151419 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104151419 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104151419 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104151421 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104151422 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104151422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104151422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:41:52.404108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30208): Terminating (SIGTERM) 10:41:52.446109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30211): Terminating (SIGTERM) 10:41:52.488125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30214): Terminating (SIGTERM) 10:41:52.530511 --- ParallelTerminationStrategy: PID 30208 died... 10:41:52.550575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30208): Terminated: ok {rc=0} 10:41:52.597456 --- ParallelTerminationStrategy: PID 30211 died... 10:41:52.617203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30211): Terminated: ok {rc=0} 10:41:52.664060 --- ParallelTerminationStrategy: PID 30214 died... 10:41:52.683853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30214): Terminated: ok {rc=0} 10:41:52.772029 bus /sierra_3: Setting Powered False 10:41:53.871353 bus /sierra_3: Setting Powered False 10:41:54.989584 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:41:56.136904 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:56.149031 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:41:56.215695 tst mo_mt_call_osmux.py: using LAC 27832 10:41:56.335245 tst mo_mt_call_osmux.py: using RAC 37 10:41:56.457217 tst mo_mt_call_osmux.py: using CellId 27832 10:41:56.579782 tst mo_mt_call_osmux.py: using BVCI 27833 10:41:56.691791 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:56.703126 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:56.714331 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:56.725569 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:56.736734 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:41:56.747856 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:41:56.866224 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:41:56.986833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:41:57.460899 run create_hlr_db(pid=30217): Launched 10:41:57.585317 bus /sierra_2: Setting Powered False 10:41:58.646808 run create_hlr_db(pid=30217): Terminated: ok {rc=0} 10:41:59.091070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30219): Launched 10:41:59.416849 run osmo-hlr_10.42.42.2(pid=30220): Launched 10:41:59.542189 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:00.105692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30222): Launched 10:42:00.433582 run osmo-stp_10.42.42.5(pid=30223): Launched 10:42:00.559341 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:01.212723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30228): Launched 10:42:01.545571 run osmo-msc_10.42.42.6(pid=30229): Launched 10:42:01.961337 run osmo-stp_10.42.42.5(pid=30223): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30223)] 10:42:02.142949 run osmo-stp_10.42.42.5(pid=30223): stdout: | (launched: 2022-12-10_10:42:00.374500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:02.278830 run osmo-stp_10.42.42.5(pid=30223): stderr: | 20221210104200567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104200567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104200567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104200568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104200568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104200568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104200568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:02.409974 run osmo-stp_10.42.42.5(pid=30223): stdout: | (launched: 2022-12-10_10:42:00.374500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:02.539203 run osmo-stp_10.42.42.5(pid=30223): stderr: | 20221210104200567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104200567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104200567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104200568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104200568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104200568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104200568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:02.696328 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30223): Process ended prematurely: osmo-stp_10.42.42.5(pid=30223) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30223)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:42:02.706082 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:42:02.735687 run osmo-hlr_10.42.42.2(pid=30220): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30220)] 10:42:02.787329 run osmo-hlr_10.42.42.2(pid=30220): stdout: | (launched: 2022-12-10_10:41:59.357837) 10:42:02.840592 run osmo-hlr_10.42.42.2(pid=30220): stderr: | 20221210104159555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104159556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104159556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104159556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104159556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104159556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104159568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104159577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104159577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104159577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:02.915108 run osmo-msc_10.42.42.6(pid=30229): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30229)] 10:42:02.966676 run osmo-msc_10.42.42.6(pid=30229): stdout: | (launched: 2022-12-10_10:42:01.479242) 10:42:03.020105 run osmo-msc_10.42.42.6(pid=30229): stderr: | 20221210104201847 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104201847 DLGLOBAL DEBUG validating counter group 0x7f0b3969cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104201847 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104201847 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104201847 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104201847 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104201851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104201851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104201851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104201851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:03.073920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30219): Terminating (SIGTERM) 10:42:03.117190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30222): Terminating (SIGTERM) 10:42:03.160612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30228): Terminating (SIGTERM) 10:42:03.204407 --- ParallelTerminationStrategy: PID 30219 died... 10:42:03.224830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30219): Terminated: ok {rc=0} 10:42:03.273608 --- ParallelTerminationStrategy: PID 30222 died... 10:42:03.293615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30222): Terminated: ok {rc=0} 10:42:03.342045 --- ParallelTerminationStrategy: PID 30228 died... 10:42:03.362041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30228): Terminated: ok {rc=0} 10:42:03.451592 bus /sierra_3: Setting Powered False 10:42:04.550906 bus /sierra_3: Setting Powered False 10:42:05.668612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:42:06.920618 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:06.927695 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:42:06.958135 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:42:06.985686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:42:07.041327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:42:07.072184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:42:07.099845 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:42:07.650927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:42:07.703942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:07.715738 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:42:07.781982 tst mo_mt_call.py: using LAC 27833 10:42:07.908214 tst mo_mt_call.py: using RAC 38 10:42:08.037330 tst mo_mt_call.py: using CellId 27833 10:42:08.162501 tst mo_mt_call.py: using BVCI 27834 10:42:08.281201 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:08.293053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:08.304571 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:08.316320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:08.328232 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:08.340082 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:08.461075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:08.581935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:09.086698 run create_hlr_db(pid=30234): Launched 10:42:09.210522 bus /sierra_2: Setting Powered False 10:42:10.275282 run create_hlr_db(pid=30234): Terminated: ok {rc=0} 10:42:10.712593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30236): Launched 10:42:11.019027 run osmo-hlr_10.42.42.2(pid=30237): Launched 10:42:11.135770 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:11.659951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30239): Launched 10:42:11.964285 run osmo-stp_10.42.42.5(pid=30240): Launched 10:42:12.080894 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:12.638541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30242): Launched 10:42:12.944892 run osmo-msc_10.42.42.6(pid=30243): Launched 10:42:13.117524 run osmo-stp_10.42.42.5(pid=30240): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30240)] 10:42:13.246569 run osmo-stp_10.42.42.5(pid=30240): stdout: | (launched: 2022-12-10_10:42:11.908715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:13.375784 run osmo-stp_10.42.42.5(pid=30240): stderr: | 20221210104212081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104212081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104212081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104212082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104212082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104212082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104212082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:13.503228 run osmo-stp_10.42.42.5(pid=30240): stdout: | (launched: 2022-12-10_10:42:11.908715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:13.624047 run osmo-stp_10.42.42.5(pid=30240): stderr: | 20221210104212081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104212081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104212081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104212082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104212082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104212082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104212082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:13.768439 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30240): Process ended prematurely: osmo-stp_10.42.42.5(pid=30240) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30240)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:42:13.777308 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:42:13.803932 run osmo-hlr_10.42.42.2(pid=30237): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30237)] 10:42:13.851785 run osmo-hlr_10.42.42.2(pid=30237): stdout: | (launched: 2022-12-10_10:42:10.963072) 10:42:13.901426 run osmo-hlr_10.42.42.2(pid=30237): stderr: | 20221210104211137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104211137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104211137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104211137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104211137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104211138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104211150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104211158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104211158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104211158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:13.971108 run osmo-msc_10.42.42.6(pid=30243): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30243)] 10:42:14.019092 run osmo-msc_10.42.42.6(pid=30243): stdout: | (launched: 2022-12-10_10:42:12.888793) 10:42:14.068625 run osmo-msc_10.42.42.6(pid=30243): stderr: | 20221210104213163 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104213163 DLGLOBAL DEBUG validating counter group 0x7f50b1d4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104213163 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104213164 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104213164 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104213164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104213166 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104213166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104213166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104213166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:14.118638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30236): Terminating (SIGTERM) 10:42:14.158756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30239): Terminating (SIGTERM) 10:42:14.198813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30242): Terminating (SIGTERM) 10:42:14.239436 --- ParallelTerminationStrategy: PID 30236 died... 10:42:14.258753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30236): Terminated: ok {rc=0} 10:42:14.303146 --- ParallelTerminationStrategy: PID 30239 died... 10:42:14.321946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30239): Terminated: ok {rc=0} 10:42:14.366240 --- ParallelTerminationStrategy: PID 30242 died... 10:42:14.385069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30242): Terminated: ok {rc=0} 10:42:14.469048 bus /sierra_3: Setting Powered False 10:42:15.567179 bus /sierra_3: Setting Powered False 10:42:16.699222 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:42:17.862399 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:17.875009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:42:17.943967 tst mo_mt_call_osmux.py: using LAC 27834 10:42:18.071440 tst mo_mt_call_osmux.py: using RAC 39 10:42:18.198898 tst mo_mt_call_osmux.py: using CellId 27834 10:42:18.327016 tst mo_mt_call_osmux.py: using BVCI 27835 10:42:18.445375 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:18.457329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:18.468921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:18.480876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:18.493049 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:42:18.504926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:18.623395 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:42:18.744257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:19.250207 run create_hlr_db(pid=30246): Launched 10:42:19.374898 bus /sierra_2: Setting Powered False 10:42:20.438878 run create_hlr_db(pid=30246): Terminated: ok {rc=0} 10:42:20.891555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Launched 10:42:21.216307 run osmo-hlr_10.42.42.2(pid=30249): Launched 10:42:21.341062 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:21.904258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Launched 10:42:22.229842 run osmo-stp_10.42.42.5(pid=30252): Launched 10:42:22.354298 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:22.945340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30254): Launched 10:42:23.270503 run osmo-msc_10.42.42.6(pid=30255): Launched 10:42:23.452671 run osmo-stp_10.42.42.5(pid=30252): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] 10:42:23.589567 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-10_10:42:22.170972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:23.727808 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221210104222364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104222364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104222364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104222364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104222365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104222365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104222365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:23.864557 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-10_10:42:22.170972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:23.993829 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221210104222364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104222364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104222364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104222364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104222365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104222365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104222365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:24.148394 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:42:24.157901 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:42:24.186473 run osmo-hlr_10.42.42.2(pid=30249): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30249)] 10:42:24.237113 run osmo-hlr_10.42.42.2(pid=30249): stdout: | (launched: 2022-12-10_10:42:21.157637) 10:42:24.289373 run osmo-hlr_10.42.42.2(pid=30249): stderr: | 20221210104221355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104221355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104221355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104221355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104221355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104221355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104221367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104221377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104221377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104221377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:24.362742 run osmo-msc_10.42.42.6(pid=30255): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30255)] 10:42:24.413461 run osmo-msc_10.42.42.6(pid=30255): stdout: | (launched: 2022-12-10_10:42:23.211589) 10:42:24.465819 run osmo-msc_10.42.42.6(pid=30255): stderr: | 20221210104223531 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104223531 DLGLOBAL DEBUG validating counter group 0x7f7858d4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104223531 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104223531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104223531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104223531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104223533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104223533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104223534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104223534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:24.518546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminating (SIGTERM) 10:42:24.560569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminating (SIGTERM) 10:42:24.602973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30254): Terminating (SIGTERM) 10:42:24.645593 --- ParallelTerminationStrategy: PID 30248 died... 10:42:24.665609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminated: ok {rc=0} 10:42:24.712825 --- ParallelTerminationStrategy: PID 30251 died... 10:42:24.733158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminated: ok {rc=0} 10:42:24.780141 --- ParallelTerminationStrategy: PID 30254 died... 10:42:24.799962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30254): Terminated: ok {rc=0} 10:42:24.889691 bus /sierra_3: Setting Powered False 10:42:25.988039 bus /sierra_3: Setting Powered False 10:42:27.102698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 10:42:28.346266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:28.352418 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 10:42:28.381285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 10:42:28.407792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 10:42:28.458850 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 10:42:28.487793 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 10:42:28.514403 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 10:42:29.068446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 10:42:29.117460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:29.128628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:42:29.197341 tst mo_mt_call.py: using LAC 27835 10:42:29.316859 tst mo_mt_call.py: using RAC 40 10:42:29.434884 tst mo_mt_call.py: using CellId 27835 10:42:29.554324 tst mo_mt_call.py: using BVCI 27836 10:42:29.664454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:29.675840 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:29.687055 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:29.698158 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:29.709386 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:29.720460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:29.839586 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:29.960800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:30.465474 run create_hlr_db(pid=30260): Launched 10:42:30.590997 bus /sierra_2: Setting Powered False 10:42:31.655311 run create_hlr_db(pid=30260): Terminated: ok {rc=0} 10:42:32.118116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30262): Launched 10:42:32.457797 run osmo-hlr_10.42.42.2(pid=30263): Launched 10:42:32.583904 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:33.147031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30265): Launched 10:42:33.472313 run osmo-stp_10.42.42.5(pid=30266): Launched 10:42:33.596657 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:34.185456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30268): Launched 10:42:34.513651 run osmo-msc_10.42.42.6(pid=30269): Launched 10:42:34.698646 run osmo-stp_10.42.42.5(pid=30266): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30266)] 10:42:34.837927 run osmo-stp_10.42.42.5(pid=30266): stdout: | (launched: 2022-12-10_10:42:33.413570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:34.977943 run osmo-stp_10.42.42.5(pid=30266): stderr: | 20221210104233608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104233608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104233608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104233609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104233609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104233609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104233609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:35.115553 run osmo-stp_10.42.42.5(pid=30266): stdout: | (launched: 2022-12-10_10:42:33.413570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:35.245681 run osmo-stp_10.42.42.5(pid=30266): stderr: | 20221210104233608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104233608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104233608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104233609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104233609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104233609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104233609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:35.401614 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30266): Process ended prematurely: osmo-stp_10.42.42.5(pid=30266) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30266)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 10:42:35.411092 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:42:35.439479 run osmo-hlr_10.42.42.2(pid=30263): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30263)] 10:42:35.490398 run osmo-hlr_10.42.42.2(pid=30263): stdout: | (launched: 2022-12-10_10:42:32.398628) 10:42:35.542777 run osmo-hlr_10.42.42.2(pid=30263): stderr: | 20221210104232597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104232597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104232597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104232597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104232597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104232598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104232610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104232620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104232620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104232620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:35.616059 run osmo-msc_10.42.42.6(pid=30269): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30269)] 10:42:35.666930 run osmo-msc_10.42.42.6(pid=30269): stdout: | (launched: 2022-12-10_10:42:34.454151) 10:42:35.719353 run osmo-msc_10.42.42.6(pid=30269): stderr: | 20221210104234776 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104234776 DLGLOBAL DEBUG validating counter group 0x7ff71380ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104234776 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104234776 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104234777 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104234777 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104234778 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104234779 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104234779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104234779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:35.772028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30262): Terminating (SIGTERM) 10:42:35.814331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30265): Terminating (SIGTERM) 10:42:35.856554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30268): Terminating (SIGTERM) 10:42:35.899229 --- ParallelTerminationStrategy: PID 30262 died... 10:42:35.919446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30262): Terminated: ok {rc=0} 10:42:35.967412 --- ParallelTerminationStrategy: PID 30265 died... 10:42:35.987678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30265): Terminated: ok {rc=0} 10:42:36.035171 --- ParallelTerminationStrategy: PID 30268 died... 10:42:36.055020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30268): Terminated: ok {rc=0} 10:42:36.143630 bus /sierra_3: Setting Powered False 10:42:37.244813 bus /sierra_3: Setting Powered False 10:42:38.361585 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 10:42:39.513391 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:39.525907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 10:42:39.594159 tst mo_mt_call_osmux.py: using LAC 27836 10:42:39.722617 tst mo_mt_call_osmux.py: using RAC 41 10:42:39.849857 tst mo_mt_call_osmux.py: using CellId 27836 10:42:39.980101 tst mo_mt_call_osmux.py: using BVCI 27837 10:42:40.099774 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:40.111596 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:40.123135 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:40.135025 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:40.147031 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 10:42:40.159098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:40.279198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 10:42:40.401794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:40.876596 run create_hlr_db(pid=30273): Launched 10:42:41.002665 bus /sierra_2: Setting Powered False 10:42:42.063680 run create_hlr_db(pid=30273): Terminated: ok {rc=0} 10:42:42.508938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30275): Launched 10:42:42.834789 run osmo-hlr_10.42.42.2(pid=30276): Launched 10:42:42.959299 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:43.521597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30278): Launched 10:42:43.849706 run osmo-stp_10.42.42.5(pid=30279): Launched 10:42:43.973861 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:44.562578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30281): Launched 10:42:44.888586 run osmo-msc_10.42.42.6(pid=30282): Launched 10:42:45.070561 run osmo-stp_10.42.42.5(pid=30279): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30279)] 10:42:45.208095 run osmo-stp_10.42.42.5(pid=30279): stdout: | (launched: 2022-12-10_10:42:43.790197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:45.346666 run osmo-stp_10.42.42.5(pid=30279): stderr: | 20221210104243984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104243984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104243984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104243985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104243985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104243985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104243985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:45.484024 run osmo-stp_10.42.42.5(pid=30279): stdout: | (launched: 2022-12-10_10:42:43.790197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:45.613971 run osmo-stp_10.42.42.5(pid=30279): stderr: | 20221210104243984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104243984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104243984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104243985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104243985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104243985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104243985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:45.769992 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30279): Process ended prematurely: osmo-stp_10.42.42.5(pid=30279) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30279)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 10:42:45.779466 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:42:45.807996 run osmo-hlr_10.42.42.2(pid=30276): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30276)] 10:42:45.860388 run osmo-hlr_10.42.42.2(pid=30276): stdout: | (launched: 2022-12-10_10:42:42.775958) 10:42:45.922643 run osmo-hlr_10.42.42.2(pid=30276): stderr: | 20221210104242975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104242975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104242975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104242975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104242975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104242975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104242987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104242996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104242996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104242996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:45.996552 run osmo-msc_10.42.42.6(pid=30282): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30282)] 10:42:46.048226 run osmo-msc_10.42.42.6(pid=30282): stdout: | (launched: 2022-12-10_10:42:44.829285) 10:42:46.108033 run osmo-msc_10.42.42.6(pid=30282): stderr: | 20221210104245152 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104245152 DLGLOBAL DEBUG validating counter group 0x7fdd15098c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104245153 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104245153 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104245153 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104245153 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104245155 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104245155 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104245155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104245155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:46.164156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30275): Terminating (SIGTERM) 10:42:46.207358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30278): Terminating (SIGTERM) 10:42:46.250758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30281): Terminating (SIGTERM) 10:42:46.295019 --- ParallelTerminationStrategy: PID 30275 died... 10:42:46.315852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30275): Terminated: ok {rc=0} 10:42:46.365383 --- ParallelTerminationStrategy: PID 30278 died... 10:42:46.386035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30278): Terminated: ok {rc=0} 10:42:46.433826 --- ParallelTerminationStrategy: PID 30281 died... 10:42:46.454132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30281): Terminated: ok {rc=0} 10:42:46.543982 bus /sierra_3: Setting Powered False 10:42:47.644454 bus /sierra_3: Setting Powered False 10:42:48.760452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:42:50.021652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:42:50.030339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:42:50.061361 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:42:50.089057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:42:50.142353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:42:50.172482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:42:50.199222 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:42:50.755305 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:42:50.805561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:42:50.817087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:42:50.882053 tst mo_mt_call.py: using LAC 27837 10:42:51.001766 tst mo_mt_call.py: using RAC 42 10:42:51.119930 tst mo_mt_call.py: using CellId 27837 10:42:51.238865 tst mo_mt_call.py: using BVCI 27838 10:42:51.348739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:42:51.360087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:42:51.371301 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:42:51.382472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:42:51.393702 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:42:51.404781 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:42:51.524079 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:42:51.645584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:42:52.152891 run create_hlr_db(pid=30287): Launched 10:42:52.278437 bus /sierra_2: Setting Powered False 10:42:53.343059 run create_hlr_db(pid=30287): Terminated: ok {rc=0} 10:42:53.779834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30289): Launched 10:42:54.085992 run osmo-hlr_10.42.42.2(pid=30290): Launched 10:42:54.203294 run osmo-stp_10.42.42.5: Starting osmo-stp 10:42:54.729408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30292): Launched 10:42:55.036475 run osmo-stp_10.42.42.5(pid=30293): Launched 10:42:55.152533 run osmo-msc_10.42.42.6: Starting osmo-msc 10:42:55.705709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30295): Launched 10:42:56.011028 run osmo-msc_10.42.42.6(pid=30296): Launched 10:42:56.181907 run osmo-stp_10.42.42.5(pid=30293): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30293)] 10:42:56.310404 run osmo-stp_10.42.42.5(pid=30293): stdout: | (launched: 2022-12-10_10:42:54.980147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:56.439373 run osmo-stp_10.42.42.5(pid=30293): stderr: | 20221210104255153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104255153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104255153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104255154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104255154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104255154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104255154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:56.566496 run osmo-stp_10.42.42.5(pid=30293): stdout: | (launched: 2022-12-10_10:42:54.980147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:42:56.687389 run osmo-stp_10.42.42.5(pid=30293): stderr: | 20221210104255153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104255153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104255153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104255154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104255154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104255154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104255154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:42:56.832298 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30293): Process ended prematurely: osmo-stp_10.42.42.5(pid=30293) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30293)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:42:56.841244 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:42:56.867847 run osmo-hlr_10.42.42.2(pid=30290): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30290)] 10:42:56.915220 run osmo-hlr_10.42.42.2(pid=30290): stdout: | (launched: 2022-12-10_10:42:54.030122) 10:42:56.964847 run osmo-hlr_10.42.42.2(pid=30290): stderr: | 20221210104254207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104254207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104254207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104254207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104254207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104254207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104254219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104254228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104254228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104254228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:42:57.033506 run osmo-msc_10.42.42.6(pid=30296): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30296)] 10:42:57.080651 run osmo-msc_10.42.42.6(pid=30296): stdout: | (launched: 2022-12-10_10:42:55.955205) 10:42:57.129621 run osmo-msc_10.42.42.6(pid=30296): stderr: | 20221210104256227 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104256227 DLGLOBAL DEBUG validating counter group 0x7fca000d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104256227 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104256227 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104256227 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104256227 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104256229 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104256230 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104256230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104256230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:42:57.178885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30289): Terminating (SIGTERM) 10:42:57.218386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30292): Terminating (SIGTERM) 10:42:57.257902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30295): Terminating (SIGTERM) 10:42:57.297654 --- ParallelTerminationStrategy: PID 30289 died... 10:42:57.316647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30289): Terminated: ok {rc=0} 10:42:57.360316 --- ParallelTerminationStrategy: PID 30292 died... 10:42:57.378882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30292): Terminated: ok {rc=0} 10:42:57.422299 --- ParallelTerminationStrategy: PID 30295 died... 10:42:57.440841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30295): Terminated: ok {rc=0} 10:42:57.526709 bus /sierra_3: Setting Powered False 10:42:58.626637 bus /sierra_3: Setting Powered False 10:42:59.740646 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:43:00.916812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:00.929932 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:43:01.000114 tst mo_mt_call_osmux.py: using LAC 27838 10:43:01.135018 tst mo_mt_call_osmux.py: using RAC 43 10:43:01.258606 tst mo_mt_call_osmux.py: using CellId 27838 10:43:01.388798 tst mo_mt_call_osmux.py: using BVCI 27839 10:43:01.538448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:01.553758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:01.568911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:01.585681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:01.600550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:43:01.616001 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:43:01.758617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:43:01.906544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:02.432326 run create_hlr_db(pid=30298): Launched 10:43:02.557890 bus /sierra_2: Setting Powered False 10:43:03.622567 run create_hlr_db(pid=30298): Terminated: ok {rc=0} 10:43:04.057375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30300): Launched 10:43:04.362780 run osmo-hlr_10.42.42.2(pid=30301): Launched 10:43:04.478958 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:05.005220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30303): Launched 10:43:05.310825 run osmo-stp_10.42.42.5(pid=30304): Launched 10:43:05.426368 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:05.978420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30306): Launched 10:43:06.284644 run osmo-msc_10.42.42.6(pid=30307): Launched 10:43:06.455609 run osmo-stp_10.42.42.5(pid=30304): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30304)] 10:43:06.585483 run osmo-stp_10.42.42.5(pid=30304): stdout: | (launched: 2022-12-10_10:43:05.254803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:06.714929 run osmo-stp_10.42.42.5(pid=30304): stderr: | 20221210104305427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104305427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104305427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104305428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104305428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104305428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104305428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:06.842761 run osmo-stp_10.42.42.5(pid=30304): stdout: | (launched: 2022-12-10_10:43:05.254803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:06.963880 run osmo-stp_10.42.42.5(pid=30304): stderr: | 20221210104305427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104305427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104305427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104305428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104305428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104305428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104305428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:07.110077 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30304): Process ended prematurely: osmo-stp_10.42.42.5(pid=30304) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30304)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:43:07.119009 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:43:07.145803 run osmo-hlr_10.42.42.2(pid=30301): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30301)] 10:43:07.193736 run osmo-hlr_10.42.42.2(pid=30301): stdout: | (launched: 2022-12-10_10:43:04.306883) 10:43:07.243275 run osmo-hlr_10.42.42.2(pid=30301): stderr: | 20221210104304484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104304484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104304484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104304484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104304484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104304484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104304496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104304505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104304505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104304505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:07.312625 run osmo-msc_10.42.42.6(pid=30307): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30307)] 10:43:07.360624 run osmo-msc_10.42.42.6(pid=30307): stdout: | (launched: 2022-12-10_10:43:06.228668) 10:43:07.409868 run osmo-msc_10.42.42.6(pid=30307): stderr: | 20221210104306502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104306503 DLGLOBAL DEBUG validating counter group 0x7f83ce0f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104306503 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104306503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104306503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104306503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104306505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104306505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104306506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104306506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:07.459472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30300): Terminating (SIGTERM) 10:43:07.499290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30303): Terminating (SIGTERM) 10:43:07.538860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30306): Terminating (SIGTERM) 10:43:07.579029 --- ParallelTerminationStrategy: PID 30300 died... 10:43:07.598378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30300): Terminated: ok {rc=0} 10:43:07.642547 --- ParallelTerminationStrategy: PID 30303 died... 10:43:07.661058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30303): Terminated: ok {rc=0} 10:43:07.705682 --- ParallelTerminationStrategy: PID 30306 died... 10:43:07.724377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30306): Terminated: ok {rc=0} 10:43:07.809502 bus /sierra_3: Setting Powered False 10:43:08.910209 bus /sierra_3: Setting Powered False 10:43:10.028119 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:43:11.276709 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:11.284721 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:43:11.315235 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:43:11.342496 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:43:11.394188 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:43:11.425391 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:43:11.453387 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:43:12.004304 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:43:12.054548 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:12.066003 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:43:12.132115 tst mo_mt_call.py: using LAC 27839 10:43:12.250241 tst mo_mt_call.py: using RAC 44 10:43:12.368662 tst mo_mt_call.py: using CellId 27839 10:43:12.486556 tst mo_mt_call.py: using BVCI 27840 10:43:12.597146 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:12.608631 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:12.619911 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:12.631799 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:12.643583 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:12.655458 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:12.775042 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:12.894284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:13.367956 run create_hlr_db(pid=30312): Launched 10:43:13.493126 bus /sierra_2: Setting Powered False 10:43:14.554360 run create_hlr_db(pid=30312): Terminated: ok {rc=0} 10:43:14.979791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30314): Launched 10:43:15.286136 run osmo-hlr_10.42.42.2(pid=30315): Launched 10:43:15.402790 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:15.967959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30317): Launched 10:43:16.338911 run osmo-stp_10.42.42.5(pid=30318): Launched 10:43:16.530923 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:17.221672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30320): Launched 10:43:17.557244 run osmo-msc_10.42.42.6(pid=30321): Launched 10:43:17.741123 run osmo-stp_10.42.42.5(pid=30318): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30318)] 10:43:17.878839 run osmo-stp_10.42.42.5(pid=30318): stdout: | (launched: 2022-12-10_10:43:16.278664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:18.017232 run osmo-stp_10.42.42.5(pid=30318): stderr: | 20221210104316604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104316604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104316604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104316608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104316609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104316609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104316609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:18.154099 run osmo-stp_10.42.42.5(pid=30318): stdout: | (launched: 2022-12-10_10:43:16.278664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:18.284131 run osmo-stp_10.42.42.5(pid=30318): stderr: | 20221210104316604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104316604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104316604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104316608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104316609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104316609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104316609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:18.440008 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30318): Process ended prematurely: osmo-stp_10.42.42.5(pid=30318) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30318)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:43:18.449710 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:43:18.478128 run osmo-hlr_10.42.42.2(pid=30315): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30315)] 10:43:18.528471 run osmo-hlr_10.42.42.2(pid=30315): stdout: | (launched: 2022-12-10_10:43:15.230327) 10:43:18.580664 run osmo-hlr_10.42.42.2(pid=30315): stderr: | 20221210104315406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104315406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104315406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104315406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104315406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104315406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104315419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104315427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104315428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104315428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:18.653499 run osmo-msc_10.42.42.6(pid=30321): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30321)] 10:43:18.704151 run osmo-msc_10.42.42.6(pid=30321): stdout: | (launched: 2022-12-10_10:43:17.497889) 10:43:18.756409 run osmo-msc_10.42.42.6(pid=30321): stderr: | 20221210104317822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104317822 DLGLOBAL DEBUG validating counter group 0x7fcb3637cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104317822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104317822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104317822 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104317822 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104317824 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104317824 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104317825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104317825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:18.809173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30314): Terminating (SIGTERM) 10:43:18.851324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30317): Terminating (SIGTERM) 10:43:18.893320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30320): Terminating (SIGTERM) 10:43:18.935595 --- ParallelTerminationStrategy: PID 30314 died... 10:43:18.955673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30314): Terminated: ok {rc=0} 10:43:19.002574 --- ParallelTerminationStrategy: PID 30317 died... 10:43:19.022329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30317): Terminated: ok {rc=0} 10:43:19.069110 --- ParallelTerminationStrategy: PID 30320 died... 10:43:19.088639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30320): Terminated: ok {rc=0} 10:43:19.177278 bus /sierra_3: Setting Powered False 10:43:20.275692 bus /sierra_3: Setting Powered False 10:43:21.391419 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:43:22.540932 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:22.553598 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:43:22.622895 tst mo_mt_call_osmux.py: using LAC 27840 10:43:22.752620 tst mo_mt_call_osmux.py: using RAC 45 10:43:22.884934 tst mo_mt_call_osmux.py: using CellId 27840 10:43:23.011077 tst mo_mt_call_osmux.py: using BVCI 27841 10:43:23.129400 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:23.141319 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:23.153145 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:23.165173 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:23.177179 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:43:23.189188 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:23.305582 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:43:23.424006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:23.928384 run create_hlr_db(pid=30323): Launched 10:43:24.052147 bus /sierra_2: Setting Powered False 10:43:25.117412 run create_hlr_db(pid=30323): Terminated: ok {rc=0} 10:43:25.570564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30325): Launched 10:43:25.896636 run osmo-hlr_10.42.42.2(pid=30326): Launched 10:43:26.021591 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:26.579936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30328): Launched 10:43:26.906520 run osmo-stp_10.42.42.5(pid=30329): Launched 10:43:27.031238 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:27.621068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30331): Launched 10:43:27.946795 run osmo-msc_10.42.42.6(pid=30332): Launched 10:43:28.129134 run osmo-stp_10.42.42.5(pid=30329): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30329)] 10:43:28.266942 run osmo-stp_10.42.42.5(pid=30329): stdout: | (launched: 2022-12-10_10:43:26.847474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:28.405857 run osmo-stp_10.42.42.5(pid=30329): stderr: | 20221210104327038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104327038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104327039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104327039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104327041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104327042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104327042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:28.543183 run osmo-stp_10.42.42.5(pid=30329): stdout: | (launched: 2022-12-10_10:43:26.847474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:28.672904 run osmo-stp_10.42.42.5(pid=30329): stderr: | 20221210104327038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104327038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104327039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104327039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104327041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104327042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104327042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:28.828694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30329): Process ended prematurely: osmo-stp_10.42.42.5(pid=30329) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30329)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:43:28.838519 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:43:28.867253 run osmo-hlr_10.42.42.2(pid=30326): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30326)] 10:43:28.917609 run osmo-hlr_10.42.42.2(pid=30326): stdout: | (launched: 2022-12-10_10:43:25.837593) 10:43:28.969748 run osmo-hlr_10.42.42.2(pid=30326): stderr: | 20221210104326036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104326036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104326036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104326036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104326036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104326036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104326076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104326085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104326085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104326085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:29.042704 run osmo-msc_10.42.42.6(pid=30332): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30332)] 10:43:29.092844 run osmo-msc_10.42.42.6(pid=30332): stdout: | (launched: 2022-12-10_10:43:27.887673) 10:43:29.144698 run osmo-msc_10.42.42.6(pid=30332): stderr: | 20221210104328208 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104328208 DLGLOBAL DEBUG validating counter group 0x7f27af613c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104328208 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104328208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104328208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104328209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104328211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104328211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104328212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104328212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:29.197099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30325): Terminating (SIGTERM) 10:43:29.239364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30328): Terminating (SIGTERM) 10:43:29.281572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30331): Terminating (SIGTERM) 10:43:29.324145 --- ParallelTerminationStrategy: PID 30325 died... 10:43:29.344282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30325): Terminated: ok {rc=0} 10:43:29.391066 --- ParallelTerminationStrategy: PID 30328 died... 10:43:29.410832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30328): Terminated: ok {rc=0} 10:43:29.457303 --- ParallelTerminationStrategy: PID 30331 died... 10:43:29.476848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30331): Terminated: ok {rc=0} 10:43:29.564738 bus /sierra_3: Setting Powered False 10:43:30.663249 bus /sierra_3: Setting Powered False 10:43:31.786339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:43:33.053323 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:33.059379 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:43:33.090200 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 10:43:33.116733 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 10:43:33.168181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:43:33.198997 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 10:43:33.226223 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 10:43:33.779210 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 10:43:33.832401 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:33.844259 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:43:33.911389 tst mo_mt_call.py: using LAC 27841 10:43:34.037348 tst mo_mt_call.py: using RAC 46 10:43:34.163455 tst mo_mt_call.py: using CellId 27841 10:43:34.284551 tst mo_mt_call.py: using BVCI 27842 10:43:34.396313 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:34.407466 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:34.418499 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:34.429927 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:34.441438 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:34.452591 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:43:34.572624 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:43:34.692214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:35.197873 run create_hlr_db(pid=30337): Launched 10:43:35.322925 bus /sierra_2: Setting Powered False 10:43:36.387165 run create_hlr_db(pid=30337): Terminated: ok {rc=0} 10:43:36.822655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30339): Launched 10:43:37.128337 run osmo-hlr_10.42.42.2(pid=30340): Launched 10:43:37.245295 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:37.775652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30342): Launched 10:43:38.081260 run osmo-stp_10.42.42.5(pid=30343): Launched 10:43:38.198006 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:38.750880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30345): Launched 10:43:39.058021 run osmo-msc_10.42.42.6(pid=30346): Launched 10:43:39.230853 run osmo-stp_10.42.42.5(pid=30343): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30343)] 10:43:39.360617 run osmo-stp_10.42.42.5(pid=30343): stdout: | (launched: 2022-12-10_10:43:38.025344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:39.498518 run osmo-stp_10.42.42.5(pid=30343): stderr: | 20221210104338196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104338197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104338197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104338197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104338198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104338198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104338198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:39.625790 run osmo-stp_10.42.42.5(pid=30343): stdout: | (launched: 2022-12-10_10:43:38.025344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:39.747083 run osmo-stp_10.42.42.5(pid=30343): stderr: | 20221210104338196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104338197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104338197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104338197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104338198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104338198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104338198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:39.892036 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30343): Process ended prematurely: osmo-stp_10.42.42.5(pid=30343) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30343)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 10:43:39.900739 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:43:39.927580 run osmo-hlr_10.42.42.2(pid=30340): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30340)] 10:43:39.975664 run osmo-hlr_10.42.42.2(pid=30340): stdout: | (launched: 2022-12-10_10:43:37.072506) 10:43:40.025173 run osmo-hlr_10.42.42.2(pid=30340): stderr: | 20221210104337251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104337251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104337252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104337252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104337252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104337252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104337263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104337272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104337272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104337272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:40.094346 run osmo-msc_10.42.42.6(pid=30346): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30346)] 10:43:40.142318 run osmo-msc_10.42.42.6(pid=30346): stdout: | (launched: 2022-12-10_10:43:39.001987) 10:43:40.191896 run osmo-msc_10.42.42.6(pid=30346): stderr: | 20221210104339275 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104339276 DLGLOBAL DEBUG validating counter group 0x7ff17ecacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104339276 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104339276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104339276 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104339276 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104339278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104339278 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104339278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104339278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:40.241856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30339): Terminating (SIGTERM) 10:43:40.281665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30342): Terminating (SIGTERM) 10:43:40.321446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30345): Terminating (SIGTERM) 10:43:40.361566 --- ParallelTerminationStrategy: PID 30339 died... 10:43:40.380460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30339): Terminated: ok {rc=0} 10:43:40.425266 --- ParallelTerminationStrategy: PID 30342 died... 10:43:40.444049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30342): Terminated: ok {rc=0} 10:43:40.489368 --- ParallelTerminationStrategy: PID 30345 died... 10:43:40.507979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30345): Terminated: ok {rc=0} 10:43:40.591959 bus /sierra_3: Setting Powered False 10:43:41.690581 bus /sierra_3: Setting Powered False 10:43:42.807653 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 10:43:43.957683 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:43.970275 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:43:44.040060 tst mo_mt_call_osmux.py: using LAC 27842 10:43:44.170741 tst mo_mt_call_osmux.py: using RAC 47 10:43:44.297852 tst mo_mt_call_osmux.py: using CellId 27842 10:43:44.423926 tst mo_mt_call_osmux.py: using BVCI 27843 10:43:44.542737 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:44.554547 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:44.566072 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:44.577748 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:44.589831 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 10:43:44.601499 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:43:44.721087 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 10:43:44.840254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:45.346077 run create_hlr_db(pid=30349): Launched 10:43:45.470307 bus /sierra_2: Setting Powered False 10:43:46.548913 run create_hlr_db(pid=30349): Terminated: ok {rc=0} 10:43:47.126141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30351): Launched 10:43:47.463231 run osmo-hlr_10.42.42.2(pid=30352): Launched 10:43:47.589509 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:48.154785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30354): Launched 10:43:48.480049 run osmo-stp_10.42.42.5(pid=30355): Launched 10:43:48.604656 run osmo-msc_10.42.42.6: Starting osmo-msc 10:43:49.192673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30357): Launched 10:43:49.518804 run osmo-msc_10.42.42.6(pid=30358): Launched 10:43:49.700259 run osmo-stp_10.42.42.5(pid=30355): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30355)] 10:43:49.837668 run osmo-stp_10.42.42.5(pid=30355): stdout: | (launched: 2022-12-10_10:43:48.420907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:49.975616 run osmo-stp_10.42.42.5(pid=30355): stderr: | 20221210104348614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104348614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104348614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104348614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104348615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104348615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104348615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:50.113156 run osmo-stp_10.42.42.5(pid=30355): stdout: | (launched: 2022-12-10_10:43:48.420907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:43:50.242913 run osmo-stp_10.42.42.5(pid=30355): stderr: | 20221210104348614 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104348614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104348614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104348614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104348615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104348615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104348615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:43:50.398485 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30355): Process ended prematurely: osmo-stp_10.42.42.5(pid=30355) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30355)] [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 10:43:50.408065 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 10:43:50.436657 run osmo-hlr_10.42.42.2(pid=30352): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30352)] 10:43:50.486622 run osmo-hlr_10.42.42.2(pid=30352): stdout: | (launched: 2022-12-10_10:43:47.403927) 10:43:50.538420 run osmo-hlr_10.42.42.2(pid=30352): stderr: | 20221210104347604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104347604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104347604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104347604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104347604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104347604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104347617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104347626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104347626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104347626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:43:50.610704 run osmo-msc_10.42.42.6(pid=30358): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30358)] 10:43:50.660540 run osmo-msc_10.42.42.6(pid=30358): stdout: | (launched: 2022-12-10_10:43:49.459835) 10:43:50.712485 run osmo-msc_10.42.42.6(pid=30358): stderr: | 20221210104349782 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104349782 DLGLOBAL DEBUG validating counter group 0x7f14fe403c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104349782 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104349782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104349782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104349783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104349785 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104349786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104349786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104349786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:43:50.764623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30351): Terminating (SIGTERM) 10:43:50.806679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30354): Terminating (SIGTERM) 10:43:50.848778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30357): Terminating (SIGTERM) 10:43:50.891406 --- ParallelTerminationStrategy: PID 30351 died... 10:43:50.911505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30351): Terminated: ok {rc=0} 10:43:50.958815 --- ParallelTerminationStrategy: PID 30354 died... 10:43:50.978531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30354): Terminated: ok {rc=0} 10:43:51.025220 --- ParallelTerminationStrategy: PID 30357 died... 10:43:51.044619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30357): Terminated: ok {rc=0} 10:43:51.132507 bus /sierra_3: Setting Powered False 10:43:52.229518 bus /sierra_3: Setting Powered False 10:43:53.343958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 10:43:54.598406 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:43:54.603562 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:43:54.633375 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 10:43:54.660187 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 10:43:54.743429 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:43:54.772284 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 10:43:54.798689 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 10:43:55.385598 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 10:43:55.390438 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:55.401535 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:43:55.447085 tst emergency_mo_mt_call.py: using LAC 27843 10:43:55.565033 tst emergency_mo_mt_call.py: using RAC 48 10:43:55.681002 tst emergency_mo_mt_call.py: using CellId 27843 10:43:55.796163 tst emergency_mo_mt_call.py: using BVCI 27844 10:43:55.904688 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:55.915585 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:55.926224 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:55.936719 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:55.947289 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:43:55.957813 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:43:56.074911 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:43:56.190494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:43:56.655587 run create_hlr_db(pid=30363): Launched 10:43:56.778250 bus /sierra_2: Setting Powered False 10:43:57.839138 run create_hlr_db(pid=30363): Terminated: ok {rc=0} 10:43:58.259151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30365): Launched 10:43:58.559886 run osmo-hlr_10.42.42.2(pid=30366): Launched 10:43:58.674380 run osmo-stp_10.42.42.5: Starting osmo-stp 10:43:59.191391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30368): Launched 10:43:59.491229 run osmo-stp_10.42.42.5(pid=30369): Launched 10:43:59.616038 tst emergency_mo_mt_call.py: using MSISDN 7689 10:43:59.772438 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:00.319665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30371): Launched 10:44:00.620879 run osmo-msc_10.42.42.6(pid=30372): Launched 10:44:00.789579 run osmo-stp_10.42.42.5(pid=30369): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30369)] 10:44:01.045464 run osmo-stp_10.42.42.5(pid=30369): stdout: | (launched: 2022-12-10_10:43:59.435711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:01.172877 run osmo-stp_10.42.42.5(pid=30369): stderr: | 20221210104359607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104359607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104359607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104359607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104359608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104359608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104359608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:01.300159 run osmo-stp_10.42.42.5(pid=30369): stdout: | (launched: 2022-12-10_10:43:59.435711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:01.422456 run osmo-stp_10.42.42.5(pid=30369): stderr: | 20221210104359607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104359607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104359607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104359607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104359608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104359608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104359608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:01.568808 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30369): Process ended prematurely: osmo-stp_10.42.42.5(pid=30369) [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30369)] [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 10:44:01.578148 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 10:44:01.605810 run osmo-hlr_10.42.42.2(pid=30366): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30366)] 10:44:01.655111 run osmo-hlr_10.42.42.2(pid=30366): stdout: | (launched: 2022-12-10_10:43:58.504529) 10:44:01.706416 run osmo-hlr_10.42.42.2(pid=30366): stderr: | 20221210104358681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104358681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104358681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104358681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104358681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104358681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104358693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104358701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104358702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104358702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:01.777462 run osmo-msc_10.42.42.6(pid=30372): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30372)] 10:44:01.827177 run osmo-msc_10.42.42.6(pid=30372): stdout: | (launched: 2022-12-10_10:44:00.565763) 10:44:01.878503 run osmo-msc_10.42.42.6(pid=30372): stderr: | 20221210104400839 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104400840 DLGLOBAL DEBUG validating counter group 0x7f155c321c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104400840 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104400840 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104400840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104400840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104400842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104400843 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104400843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104400847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:01.930430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30365): Terminating (SIGTERM) 10:44:01.972401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30368): Terminating (SIGTERM) 10:44:02.015432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30371): Terminating (SIGTERM) 10:44:02.057867 --- ParallelTerminationStrategy: PID 30365 died... 10:44:02.078073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30365): Terminated: ok {rc=0} 10:44:02.124684 --- ParallelTerminationStrategy: PID 30368 died... 10:44:02.144103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30368): Terminated: ok {rc=0} 10:44:02.189180 --- ParallelTerminationStrategy: PID 30371 died... 10:44:02.208427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30371): Terminated: ok {rc=0} 10:44:02.295003 bus /sierra_3: Setting Powered False 10:44:03.393095 bus /sierra_3: Setting Powered False 10:44:04.510074 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 10:44:05.596207 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:44:05.608337 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:44:05.657205 tst emergency_preemptive_call.py: using LAC 27844 10:44:05.784143 tst emergency_preemptive_call.py: using RAC 49 10:44:05.909862 tst emergency_preemptive_call.py: using CellId 27844 10:44:06.035173 tst emergency_preemptive_call.py: using BVCI 27845 10:44:06.152005 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:44:06.163466 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:44:06.174719 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:44:06.186145 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:44:06.197664 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 10:44:06.209236 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:06.327854 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:06.446518 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:06.562671 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:06.679303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:07.178054 run create_hlr_db(pid=30374): Launched 10:44:07.300462 bus /sierra_2: Setting Powered False 10:44:08.364580 run create_hlr_db(pid=30374): Terminated: ok {rc=0} 10:44:08.795722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30376): Launched 10:44:09.097490 run osmo-hlr_10.42.42.2(pid=30377): Launched 10:44:09.212647 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:09.747520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30379): Launched 10:44:10.048054 run osmo-stp_10.42.42.5(pid=30380): Launched 10:44:10.171806 tst emergency_preemptive_call.py: using MSISDN 7690 10:44:10.337138 run osmo-msc_10.42.42.6: Starting osmo-msc 10:44:10.873215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30382): Launched 10:44:11.173585 run osmo-msc_10.42.42.6(pid=30383): Launched 10:44:11.342690 run osmo-stp_10.42.42.5(pid=30380): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30380)] 10:44:11.469479 run osmo-stp_10.42.42.5(pid=30380): stdout: | (launched: 2022-12-10_10:44:09.992623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:11.597463 run osmo-stp_10.42.42.5(pid=30380): stderr: | 20221210104410161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104410161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104410162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104410162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104410165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104410165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104410165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:11.722304 run osmo-stp_10.42.42.5(pid=30380): stdout: | (launched: 2022-12-10_10:44:09.992623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:11.842185 run osmo-stp_10.42.42.5(pid=30380): stderr: | 20221210104410161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104410161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104410162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104410162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104410165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104410165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104410165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:11.985143 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30380): Process ended prematurely: osmo-stp_10.42.42.5(pid=30380) [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30380)] [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 10:44:11.993363 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 10:44:12.019573 run osmo-hlr_10.42.42.2(pid=30377): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30377)] 10:44:12.067018 run osmo-hlr_10.42.42.2(pid=30377): stdout: | (launched: 2022-12-10_10:44:09.042400) 10:44:12.116164 run osmo-hlr_10.42.42.2(pid=30377): stderr: | 20221210104409219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104409219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104409219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104409219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104409219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104409220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104409231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104409240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104409240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104409241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:12.184980 run osmo-msc_10.42.42.6(pid=30383): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30383)] 10:44:12.232429 run osmo-msc_10.42.42.6(pid=30383): stdout: | (launched: 2022-12-10_10:44:11.118620) 10:44:12.281502 run osmo-msc_10.42.42.6(pid=30383): stderr: | 20221210104411390 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104411390 DLGLOBAL DEBUG validating counter group 0x7f60ce574c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104411390 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104411390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104411390 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104411391 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104411392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104411393 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104411393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104411393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:44:12.330964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30376): Terminating (SIGTERM) 10:44:12.370421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30379): Terminating (SIGTERM) 10:44:12.409865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30382): Terminating (SIGTERM) 10:44:12.449594 --- ParallelTerminationStrategy: PID 30376 died... 10:44:12.468523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30376): Terminated: ok {rc=0} 10:44:12.512721 --- ParallelTerminationStrategy: PID 30379 died... 10:44:12.531346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30379): Terminated: ok {rc=0} 10:44:12.575008 --- ParallelTerminationStrategy: PID 30382 died... 10:44:12.593548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30382): Terminated: ok {rc=0} 10:44:12.678507 bus /sierra_9: Setting Powered False 10:44:13.777369 bus /sierra_9: Setting Powered False 10:44:14.891786 bus /sierra_8: Setting Powered False 10:44:15.995229 bus /sierra_8: Setting Powered False 10:44:17.113176 bus /sierra_3: Setting Powered False 10:44:18.212525 bus /sierra_3: Setting Powered False 10:44:19.328607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 10:44:20.603648 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:44:20.608384 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 10:44:20.639002 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 10:44:20.679291 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 10:44:20.768879 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 10:44:20.799425 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 10:44:20.839128 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 10:44:21.433518 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 10:44:21.487119 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:21.498463 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:44:21.545132 tst cs_paging_gprs_active.py: using LAC 27845 10:44:21.674307 tst cs_paging_gprs_active.py: using RAC 50 10:44:21.795542 tst cs_paging_gprs_active.py: using CellId 27845 10:44:21.915415 tst cs_paging_gprs_active.py: using BVCI 27846 10:44:22.036265 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.047624 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.058798 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.070658 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.082316 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.094016 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.106003 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.117870 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:22.130498 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:22.247980 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:22.367273 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:44:22.590880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:22.921096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30389): Launched 10:44:23.207522 run iperf3-srv_10.42.42.10(pid=30390): Launched 10:44:23.330790 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:44:23.552033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:23.881559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30391): Launched 10:44:24.167524 run iperf3-srv_10.42.42.10(pid=30392): Launched 10:44:24.290799 tst cs_paging_gprs_active.py:38: start network... 10:44:24.512399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:25.018449 run create_hlr_db(pid=30393): Launched 10:44:25.143517 bus /sierra_2: Setting Powered False 10:44:26.208452 run create_hlr_db(pid=30393): Terminated: ok {rc=0} 10:44:26.645214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30395): Launched 10:44:26.951835 run osmo-hlr_10.42.42.2(pid=30396): Launched 10:44:27.068782 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:27.596661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30398): Launched 10:44:27.904428 run osmo-stp_10.42.42.5(pid=30399): Launched 10:44:28.021719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:28.550001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30401): Launched 10:44:28.667804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:28.926886 run patchelf(pid=30402): Launched 10:44:29.098286 run osmo-stp_10.42.42.5(pid=30399): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30399)] 10:44:29.227832 run osmo-stp_10.42.42.5(pid=30399): stdout: | (launched: 2022-12-10_10:44:27.848148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:29.359196 run osmo-stp_10.42.42.5(pid=30399): stderr: | 20221210104428020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104428020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104428020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104428021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104428021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104428021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104428021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:29.490587 run osmo-stp_10.42.42.5(pid=30399): stdout: | (launched: 2022-12-10_10:44:27.848148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:29.616229 run osmo-stp_10.42.42.5(pid=30399): stderr: | 20221210104428020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104428020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104428020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104428021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104428021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104428021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104428021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:29.765432 run patchelf(pid=30402): Terminating (SIGINT) 10:44:29.937994 run patchelf(pid=30402): Terminated: ok {rc=0} 10:44:30.062072 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30399): Process ended prematurely: osmo-stp_10.42.42.5(pid=30399) [trial-2373↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30399)] [trial-2373↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 10:44:30.071612 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:44:30.099201 run osmo-hlr_10.42.42.2(pid=30396): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30396)] 10:44:30.146595 run osmo-hlr_10.42.42.2(pid=30396): stdout: | (launched: 2022-12-10_10:44:26.895678) 10:44:30.195515 run osmo-hlr_10.42.42.2(pid=30396): stderr: | 20221210104427071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104427071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104427072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104427072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104427072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104427072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104427087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104427096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104427096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104427096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:30.244782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30389): Terminating (SIGTERM) 10:44:30.284465 run iperf3-srv_10.42.42.10(pid=30390): Terminating (SIGTERM) 10:44:30.323965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30391): Terminating (SIGTERM) 10:44:30.363353 run iperf3-srv_10.42.42.10(pid=30392): Terminating (SIGTERM) 10:44:30.403277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30395): Terminating (SIGTERM) 10:44:30.443012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30398): Terminating (SIGTERM) 10:44:30.482743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30401): Terminating (SIGTERM) 10:44:30.522704 --- ParallelTerminationStrategy: PID 30389 died... 10:44:30.541813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30389): Terminated: ok {rc=0} 10:44:30.586297 --- ParallelTerminationStrategy: PID 30390 died... 10:44:30.604855 run iperf3-srv_10.42.42.10(pid=30390): Terminated {rc=256} 10:44:30.648809 --- ParallelTerminationStrategy: PID 30391 died... 10:44:30.667940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30391): Terminated: ok {rc=0} 10:44:30.711912 --- ParallelTerminationStrategy: PID 30392 died... 10:44:30.730622 run iperf3-srv_10.42.42.10(pid=30392): Terminated {rc=256} 10:44:30.774779 --- ParallelTerminationStrategy: PID 30395 died... 10:44:30.793591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30395): Terminated: ok {rc=0} 10:44:30.848116 --- ParallelTerminationStrategy: PID 30398 died... 10:44:30.876757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30398): Terminated: ok {rc=0} 10:44:30.933739 --- ParallelTerminationStrategy: PID 30401 died... 10:44:30.953079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30401): Terminated: ok {rc=0} 10:44:31.038717 bus /gobi_0: Setting Powered False 10:44:32.133888 bus /gobi_0: Setting Powered False 10:44:33.246510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 10:44:34.396047 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:34.408062 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:44:34.457369 tst iperf3.py: using LAC 27846 10:44:34.582119 tst iperf3.py: using RAC 51 10:44:34.706956 tst iperf3.py: using CellId 27846 10:44:34.827548 tst iperf3.py: using BVCI 27847 10:44:34.940181 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:34.951284 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:34.962221 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:34.973563 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:34.984566 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:34.995616 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:35.006912 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:35.018070 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:35.029421 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:35.145494 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:44:35.351600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:35.660640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30403): Launched 10:44:35.929694 run iperf3-srv_10.42.42.10(pid=30404): Launched 10:44:36.044768 tst iperf3.py:8: start network... 10:44:36.250133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:36.724554 run create_hlr_db(pid=30405): Launched 10:44:36.850025 bus /gobi_6: Setting Powered False 10:44:37.911569 run create_hlr_db(pid=30405): Terminated: ok {rc=0} 10:44:38.356533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30407): Launched 10:44:38.684310 run osmo-hlr_10.42.42.2(pid=30408): Launched 10:44:38.810085 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:39.378309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30410): Launched 10:44:39.704646 run osmo-stp_10.42.42.5(pid=30411): Launched 10:44:39.830630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:40.393529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30413): Launched 10:44:40.519494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:40.796561 run patchelf(pid=30414): Launched 10:44:40.978948 run osmo-stp_10.42.42.5(pid=30411): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30411)] 10:44:41.117524 run osmo-stp_10.42.42.5(pid=30411): stdout: | (launched: 2022-12-10_10:44:39.645627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:41.257505 run osmo-stp_10.42.42.5(pid=30411): stderr: | 20221210104439838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104439838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104439839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104439839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104439839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104439839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104439840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:41.397700 run osmo-stp_10.42.42.5(pid=30411): stdout: | (launched: 2022-12-10_10:44:39.645627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:41.531432 run osmo-stp_10.42.42.5(pid=30411): stderr: | 20221210104439838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104439838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104439839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104439839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104439839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104439839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104439840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:41.690612 run patchelf(pid=30414): Terminating (SIGINT) 10:44:41.874764 run patchelf(pid=30414): Terminated: ok {rc=0} 10:44:42.007455 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30411): Process ended prematurely: osmo-stp_10.42.42.5(pid=30411) [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30411)] [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 10:44:42.017579 tst iperf3.py:8: Test FAILED (7.7 sec) 10:44:42.046955 run osmo-hlr_10.42.42.2(pid=30408): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30408)] 10:44:42.097838 run osmo-hlr_10.42.42.2(pid=30408): stdout: | (launched: 2022-12-10_10:44:38.624901) 10:44:42.150256 run osmo-hlr_10.42.42.2(pid=30408): stderr: | 20221210104438827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104438827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104438827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104438827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104438827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104438827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104438839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104438849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104438850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104438850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:42.203202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30403): Terminating (SIGTERM) 10:44:42.245906 run iperf3-srv_10.42.42.10(pid=30404): Terminating (SIGTERM) 10:44:42.288223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30407): Terminating (SIGTERM) 10:44:42.330880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30410): Terminating (SIGTERM) 10:44:42.373236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30413): Terminating (SIGTERM) 10:44:42.415994 --- ParallelTerminationStrategy: PID 30403 died... 10:44:42.435961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30403): Terminated: ok {rc=0} 10:44:42.483292 --- ParallelTerminationStrategy: PID 30404 died... 10:44:42.502957 run iperf3-srv_10.42.42.10(pid=30404): Terminated {rc=256} 10:44:42.549643 --- ParallelTerminationStrategy: PID 30407 died... 10:44:42.569400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30407): Terminated: ok {rc=0} 10:44:42.616695 --- ParallelTerminationStrategy: PID 30410 died... 10:44:42.636347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30410): Terminated: ok {rc=0} 10:44:42.683245 --- ParallelTerminationStrategy: PID 30413 died... 10:44:42.702918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30413): Terminated: ok {rc=0} 10:44:42.790911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 10:44:43.939199 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:43.950738 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:44:43.998240 tst iperf3m4.py: using LAC 27847 10:44:44.121110 tst iperf3m4.py: using RAC 52 10:44:44.245735 tst iperf3m4.py: using CellId 27847 10:44:44.366562 tst iperf3m4.py: using BVCI 27848 10:44:44.478920 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.490032 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.501050 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.512364 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.523621 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.534672 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.546065 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.557228 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:44:44.568633 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:44.690450 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:44.809574 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:44.929349 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:44:45.049476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:44:45.254565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:45.561175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30415): Launched 10:44:45.838267 run iperf3-srv_10.42.42.10(pid=30416): Launched 10:44:46.003487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:44:46.214291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:46.539566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30417): Launched 10:44:46.885696 run iperf3-srv_10.42.42.10(pid=30418): Launched 10:44:47.018375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:44:47.244577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:47.573149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30419): Launched 10:44:47.858226 run iperf3-srv_10.42.42.10(pid=30420): Launched 10:44:47.981556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:44:48.202302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:44:48.529899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30421): Launched 10:44:48.816527 run iperf3-srv_10.42.42.10(pid=30422): Launched 10:44:48.939660 tst iperf3m4.py:8: start network... 10:44:49.159973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:44:49.664781 run create_hlr_db(pid=30423): Launched 10:44:49.789859 bus /gobi_6: Setting Powered False 10:44:50.853339 run create_hlr_db(pid=30423): Terminated: ok {rc=0} 10:44:51.306284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30425): Launched 10:44:51.633711 run osmo-hlr_10.42.42.2(pid=30426): Launched 10:44:51.759555 run osmo-stp_10.42.42.5: Starting osmo-stp 10:44:52.424578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30428): Launched 10:44:52.742910 run osmo-stp_10.42.42.5(pid=30429): Launched 10:44:52.865041 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:44:53.415642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30431): Launched 10:44:53.538263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:44:53.807555 run patchelf(pid=30432): Launched 10:44:53.986041 run osmo-stp_10.42.42.5(pid=30429): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30429)] 10:44:54.121960 run osmo-stp_10.42.42.5(pid=30429): stdout: | (launched: 2022-12-10_10:44:52.685364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:54.259136 run osmo-stp_10.42.42.5(pid=30429): stderr: | 20221210104452877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104452878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104452878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104452878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104452879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104452879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104452879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:54.395703 run osmo-stp_10.42.42.5(pid=30429): stdout: | (launched: 2022-12-10_10:44:52.685364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:44:54.526820 run osmo-stp_10.42.42.5(pid=30429): stderr: | 20221210104452877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104452878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104452878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104452878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104452879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104452879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104452879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:44:54.681876 run patchelf(pid=30432): Terminating (SIGINT) 10:44:54.861476 run patchelf(pid=30432): Terminated: ok {rc=0} 10:44:54.991171 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30429): Process ended prematurely: osmo-stp_10.42.42.5(pid=30429) [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30429)] [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 10:44:55.001428 tst iperf3m4.py:8: Test FAILED (11.1 sec) 10:44:55.030875 run osmo-hlr_10.42.42.2(pid=30426): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30426)] 10:44:55.081238 run osmo-hlr_10.42.42.2(pid=30426): stdout: | (launched: 2022-12-10_10:44:51.574117) 10:44:55.133404 run osmo-hlr_10.42.42.2(pid=30426): stderr: | 20221210104451774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104451774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104451774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104451774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104451774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104451774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104451788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104451796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104451796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104451796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:44:55.185585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30415): Terminating (SIGTERM) 10:44:55.227399 run iperf3-srv_10.42.42.10(pid=30416): Terminating (SIGTERM) 10:44:55.270586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30417): Terminating (SIGTERM) 10:44:55.312669 run iperf3-srv_10.42.42.10(pid=30418): Terminating (SIGTERM) 10:44:55.354343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30419): Terminating (SIGTERM) 10:44:55.396275 run iperf3-srv_10.42.42.10(pid=30420): Terminating (SIGTERM) 10:44:55.438113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30421): Terminating (SIGTERM) 10:44:55.479951 run iperf3-srv_10.42.42.10(pid=30422): Terminating (SIGTERM) 10:44:55.521842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30425): Terminating (SIGTERM) 10:44:55.563617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30428): Terminating (SIGTERM) 10:44:55.605418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30431): Terminating (SIGTERM) 10:44:55.647431 --- ParallelTerminationStrategy: PID 30415 died... 10:44:55.667302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30415): Terminated: ok {rc=0} 10:44:55.713680 --- ParallelTerminationStrategy: PID 30416 died... 10:44:55.733267 run iperf3-srv_10.42.42.10(pid=30416): Terminated {rc=256} 10:44:55.779796 --- ParallelTerminationStrategy: PID 30417 died... 10:44:55.799350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30417): Terminated: ok {rc=0} 10:44:55.845637 --- ParallelTerminationStrategy: PID 30418 died... 10:44:55.865105 run iperf3-srv_10.42.42.10(pid=30418): Terminated {rc=256} 10:44:55.911480 --- ParallelTerminationStrategy: PID 30419 died... 10:44:55.931148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30419): Terminated: ok {rc=0} 10:44:55.977482 --- ParallelTerminationStrategy: PID 30420 died... 10:44:55.997352 run iperf3-srv_10.42.42.10(pid=30420): Terminated {rc=256} 10:44:56.043649 --- ParallelTerminationStrategy: PID 30421 died... 10:44:56.063294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30421): Terminated: ok {rc=0} 10:44:56.109735 --- ParallelTerminationStrategy: PID 30422 died... 10:44:56.129407 run iperf3-srv_10.42.42.10(pid=30422): Terminated {rc=256} 10:44:56.175566 --- ParallelTerminationStrategy: PID 30425 died... 10:44:56.195146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30425): Terminated: ok {rc=0} 10:44:56.241392 --- ParallelTerminationStrategy: PID 30428 died... 10:44:56.260794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30428): Terminated: ok {rc=0} 10:44:56.306982 --- ParallelTerminationStrategy: PID 30431 died... 10:44:56.326422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30431): Terminated: ok {rc=0} 10:44:56.414051 bus /gobi_4: Setting Powered False 10:44:57.511725 bus /gobi_4: Setting Powered False 10:44:58.625157 bus /gobi_1: Setting Powered False 10:44:59.722785 bus /gobi_1: Setting Powered False 10:45:00.854328 bus /gobi_0: Setting Powered False 10:45:01.970839 bus /gobi_0: Setting Powered False 10:45:03.095786 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 10:45:04.198057 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.209957 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:45:04.257253 tst ping.py: using LAC 27848 10:45:04.381534 tst ping.py: using RAC 53 10:45:04.499883 tst ping.py: using CellId 27848 10:45:04.617414 tst ping.py: using BVCI 27849 10:45:04.723732 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.734514 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.745222 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.755869 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.766383 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.777041 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.788114 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:04.798650 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:45:04.912450 tst ping.py:19: start network... 10:45:05.109454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:05.564625 run create_hlr_db(pid=30436): Launched 10:45:05.685236 bus /gobi_6: Setting Powered False 10:45:06.744506 run create_hlr_db(pid=30436): Terminated: ok {rc=0} 10:45:07.157833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30438): Launched 10:45:07.452813 run osmo-hlr_10.42.42.2(pid=30439): Launched 10:45:07.566583 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:08.074494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30441): Launched 10:45:08.368890 run osmo-stp_10.42.42.5(pid=30442): Launched 10:45:08.481887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:08.991310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30444): Launched 10:45:09.103921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:09.351984 run patchelf(pid=30445): Launched 10:45:09.515756 run osmo-stp_10.42.42.5(pid=30442): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30442)] 10:45:09.640382 run osmo-stp_10.42.42.5(pid=30442): stdout: | (launched: 2022-12-10_10:45:08.315270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:09.767136 run osmo-stp_10.42.42.5(pid=30442): stderr: | 20221210104508487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104508487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104508487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104508488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104508488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104508488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104508488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:09.893960 run osmo-stp_10.42.42.5(pid=30442): stdout: | (launched: 2022-12-10_10:45:08.315270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:10.015110 run osmo-stp_10.42.42.5(pid=30442): stderr: | 20221210104508487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104508487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104508487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104508488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104508488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104508488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104508488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:10.158357 run patchelf(pid=30445): Terminating (SIGINT) 10:45:10.323937 run patchelf(pid=30445): Terminated: ok {rc=0} 10:45:10.443699 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30442): Process ended prematurely: osmo-stp_10.42.42.5(pid=30442) [trial-2373↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30442)] [trial-2373↪gprs:trx-lms-limenet-micro↪ping.py:22] 10:45:10.452427 tst ping.py:22: Test FAILED (6.2 sec) 10:45:10.478936 run osmo-hlr_10.42.42.2(pid=30439): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30439)] 10:45:10.526395 run osmo-hlr_10.42.42.2(pid=30439): stdout: | (launched: 2022-12-10_10:45:07.398796) 10:45:10.575972 run osmo-hlr_10.42.42.2(pid=30439): stderr: | 20221210104507573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104507573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104507573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104507573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104507573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104507573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104507605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104507616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104507616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104507616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:10.625916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30438): Terminating (SIGTERM) 10:45:10.665527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30441): Terminating (SIGTERM) 10:45:10.704923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30444): Terminating (SIGTERM) 10:45:10.744344 --- ParallelTerminationStrategy: PID 30438 died... 10:45:10.763137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30438): Terminated: ok {rc=0} 10:45:10.807019 --- ParallelTerminationStrategy: PID 30441 died... 10:45:10.825439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30441): Terminated: ok {rc=0} 10:45:10.869104 --- ParallelTerminationStrategy: PID 30444 died... 10:45:10.887479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30444): Terminated: ok {rc=0} 10:45:10.972503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 10:45:12.061581 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.073411 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 10:45:12.124786 tst ping_idle_ping.py: using LAC 27849 10:45:12.239846 tst ping_idle_ping.py: using RAC 54 10:45:12.355698 tst ping_idle_ping.py: using CellId 27849 10:45:12.470965 tst ping_idle_ping.py: using BVCI 27850 10:45:12.579396 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.590104 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.600646 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.611119 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.621550 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.632002 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.642785 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 10:45:12.653377 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 10:45:12.769063 tst ping_idle_ping.py:24: start network... 10:45:12.981975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:13.470117 run create_hlr_db(pid=30446): Launched 10:45:13.590713 bus /gobi_6: Setting Powered False 10:45:14.652936 run create_hlr_db(pid=30446): Terminated: ok {rc=0} 10:45:15.093134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30448): Launched 10:45:15.407450 run osmo-hlr_10.42.42.2(pid=30449): Launched 10:45:15.528104 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:16.117240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30451): Launched 10:45:16.461263 run osmo-stp_10.42.42.5(pid=30452): Launched 10:45:16.693424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:17.379327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30454): Launched 10:45:17.501447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:17.768198 run patchelf(pid=30455): Launched 10:45:17.943493 run osmo-stp_10.42.42.5(pid=30452): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30452)] 10:45:18.077611 run osmo-stp_10.42.42.5(pid=30452): stdout: | (launched: 2022-12-10_10:45:16.391026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:18.213288 run osmo-stp_10.42.42.5(pid=30452): stderr: | 20221210104516703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104516703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104516704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104516704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104516706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104516707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104516707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:18.349115 run osmo-stp_10.42.42.5(pid=30452): stdout: | (launched: 2022-12-10_10:45:16.391026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:18.478465 run osmo-stp_10.42.42.5(pid=30452): stderr: | 20221210104516703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104516703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104516704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104516704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104516706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104516707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104516707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:18.631735 run patchelf(pid=30455): Terminating (SIGINT) 10:45:18.808656 run patchelf(pid=30455): Terminated: ok {rc=0} 10:45:18.936146 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30452): Process ended prematurely: osmo-stp_10.42.42.5(pid=30452) [trial-2373↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30452)] [trial-2373↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 10:45:18.945654 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 10:45:18.974162 run osmo-hlr_10.42.42.2(pid=30449): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30449)] 10:45:19.024443 run osmo-hlr_10.42.42.2(pid=30449): stdout: | (launched: 2022-12-10_10:45:15.350681) 10:45:19.076285 run osmo-hlr_10.42.42.2(pid=30449): stderr: | 20221210104515546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104515546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104515547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104515547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104515547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104515547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104515563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104515572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104515573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104515573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:19.128548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30448): Terminating (SIGTERM) 10:45:19.170498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30451): Terminating (SIGTERM) 10:45:19.212588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30454): Terminating (SIGTERM) 10:45:19.255243 --- ParallelTerminationStrategy: PID 30448 died... 10:45:19.275340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30448): Terminated: ok {rc=0} 10:45:19.322048 --- ParallelTerminationStrategy: PID 30451 died... 10:45:19.341679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30451): Terminated: ok {rc=0} 10:45:19.388238 --- ParallelTerminationStrategy: PID 30454 died... 10:45:19.407787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30454): Terminated: ok {rc=0} 10:45:19.497257 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 10:45:20.792046 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:45:20.797240 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:45:20.826429 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:45:20.864763 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:45:20.951464 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:45:20.980377 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:45:21.018924 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:45:21.619941 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:45:21.672293 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:21.683928 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:45:21.731803 tst cs_paging_gprs_active.py: using LAC 27850 10:45:21.859306 tst cs_paging_gprs_active.py: using RAC 55 10:45:21.988277 tst cs_paging_gprs_active.py: using CellId 27850 10:45:22.113756 tst cs_paging_gprs_active.py: using BVCI 27851 10:45:22.230215 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.241794 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.253047 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.264472 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.275887 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.287358 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.299025 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.310332 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:22.322055 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:45:22.438524 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:45:22.555654 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:45:22.758513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:23.060661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30461): Launched 10:45:23.324332 run iperf3-srv_10.42.42.10(pid=30462): Launched 10:45:23.437208 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:45:23.638395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:23.939731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30463): Launched 10:45:24.202261 run iperf3-srv_10.42.42.10(pid=30464): Launched 10:45:24.315069 tst cs_paging_gprs_active.py:38: start network... 10:45:24.516317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:24.982023 run create_hlr_db(pid=30465): Launched 10:45:25.106091 bus /gobi_6: Setting Powered False 10:45:26.167092 run create_hlr_db(pid=30465): Terminated: ok {rc=0} 10:45:26.607325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30467): Launched 10:45:26.929177 run osmo-hlr_10.42.42.2(pid=30468): Launched 10:45:27.053211 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:27.606601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30470): Launched 10:45:27.927037 run osmo-stp_10.42.42.5(pid=30471): Launched 10:45:28.049447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:28.603114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30473): Launched 10:45:28.727183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:28.998671 run patchelf(pid=30474): Launched 10:45:29.177568 run osmo-stp_10.42.42.5(pid=30471): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30471)] 10:45:29.313883 run osmo-stp_10.42.42.5(pid=30471): stdout: | (launched: 2022-12-10_10:45:27.868911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:29.451665 run osmo-stp_10.42.42.5(pid=30471): stderr: | 20221210104528062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104528062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104528062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104528062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104528063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104528063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104528063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:29.589280 run osmo-stp_10.42.42.5(pid=30471): stdout: | (launched: 2022-12-10_10:45:27.868911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:29.721182 run osmo-stp_10.42.42.5(pid=30471): stderr: | 20221210104528062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104528062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104528062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104528062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104528063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104528063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104528063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:29.877523 run patchelf(pid=30474): Terminating (SIGINT) 10:45:30.058482 run patchelf(pid=30474): Terminated: ok {rc=0} 10:45:30.189591 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30471): Process ended prematurely: osmo-stp_10.42.42.5(pid=30471) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30471)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:45:30.199814 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:45:30.229007 run osmo-hlr_10.42.42.2(pid=30468): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30468)] 10:45:30.279381 run osmo-hlr_10.42.42.2(pid=30468): stdout: | (launched: 2022-12-10_10:45:26.871029) 10:45:30.331402 run osmo-hlr_10.42.42.2(pid=30468): stderr: | 20221210104527067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104527067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104527067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104527067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104527067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104527067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104527079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104527088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104527088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104527088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:30.383765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30461): Terminating (SIGTERM) 10:45:30.425892 run iperf3-srv_10.42.42.10(pid=30462): Terminating (SIGTERM) 10:45:30.467872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30463): Terminating (SIGTERM) 10:45:30.509946 run iperf3-srv_10.42.42.10(pid=30464): Terminating (SIGTERM) 10:45:30.551683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30467): Terminating (SIGTERM) 10:45:30.593986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30470): Terminating (SIGTERM) 10:45:30.635952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30473): Terminating (SIGTERM) 10:45:30.678323 --- ParallelTerminationStrategy: PID 30461 died... 10:45:30.698336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30461): Terminated: ok {rc=0} 10:45:30.745505 --- ParallelTerminationStrategy: PID 30462 died... 10:45:30.765205 run iperf3-srv_10.42.42.10(pid=30462): Terminated {rc=256} 10:45:30.811715 --- ParallelTerminationStrategy: PID 30463 died... 10:45:30.831534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30463): Terminated: ok {rc=0} 10:45:30.879579 --- ParallelTerminationStrategy: PID 30464 died... 10:45:30.899523 run iperf3-srv_10.42.42.10(pid=30464): Terminated {rc=256} 10:45:30.946838 --- ParallelTerminationStrategy: PID 30467 died... 10:45:30.966976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30467): Terminated: ok {rc=0} 10:45:31.014170 --- ParallelTerminationStrategy: PID 30470 died... 10:45:31.034300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30470): Terminated: ok {rc=0} 10:45:31.081737 --- ParallelTerminationStrategy: PID 30473 died... 10:45:31.102111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30473): Terminated: ok {rc=0} 10:45:31.191705 bus /gobi_0: Setting Powered False 10:45:32.290849 bus /gobi_0: Setting Powered False 10:45:33.409253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:45:34.555296 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:34.566939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:45:34.613906 tst iperf3.py: using LAC 27851 10:45:34.733091 tst iperf3.py: using RAC 56 10:45:34.851188 tst iperf3.py: using CellId 27851 10:45:34.968780 tst iperf3.py: using BVCI 27852 10:45:35.077782 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.088754 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.099695 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.110455 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.121246 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.131957 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.142879 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.153625 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:35.164459 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:45:35.278293 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:45:35.478471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:35.778683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30475): Launched 10:45:36.039896 run iperf3-srv_10.42.42.10(pid=30476): Launched 10:45:36.152530 tst iperf3.py:8: start network... 10:45:36.354195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:36.817651 run create_hlr_db(pid=30477): Launched 10:45:36.942122 bus /gobi_6: Setting Powered False 10:45:38.001588 run create_hlr_db(pid=30477): Terminated: ok {rc=0} 10:45:38.420552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30479): Launched 10:45:38.720935 run osmo-hlr_10.42.42.2(pid=30480): Launched 10:45:38.835612 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:39.364200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30482): Launched 10:45:39.663750 run osmo-stp_10.42.42.5(pid=30483): Launched 10:45:39.778861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:40.295320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30485): Launched 10:45:40.410128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:40.662169 run patchelf(pid=30486): Launched 10:45:40.829245 run osmo-stp_10.42.42.5(pid=30483): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30483)] 10:45:40.956531 run osmo-stp_10.42.42.5(pid=30483): stdout: | (launched: 2022-12-10_10:45:39.608872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:41.084546 run osmo-stp_10.42.42.5(pid=30483): stderr: | 20221210104539779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104539779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104539779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104539779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104539780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104539780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104539780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:41.212867 run osmo-stp_10.42.42.5(pid=30483): stdout: | (launched: 2022-12-10_10:45:39.608872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:41.335212 run osmo-stp_10.42.42.5(pid=30483): stderr: | 20221210104539779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104539779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104539779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104539779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104539780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104539780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104539780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:41.479812 run patchelf(pid=30486): Terminating (SIGINT) 10:45:41.647848 run patchelf(pid=30486): Terminated: ok {rc=0} 10:45:41.769389 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30483): Process ended prematurely: osmo-stp_10.42.42.5(pid=30483) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30483)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 10:45:41.778637 tst iperf3.py:8: Test FAILED (7.3 sec) 10:45:41.805637 run osmo-hlr_10.42.42.2(pid=30480): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30480)] 10:45:41.852635 run osmo-hlr_10.42.42.2(pid=30480): stdout: | (launched: 2022-12-10_10:45:38.666202) 10:45:41.901514 run osmo-hlr_10.42.42.2(pid=30480): stderr: | 20221210104538845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104538845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104538845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104538845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104538845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104538845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104538857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104538867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104538867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104538867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:41.950789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30475): Terminating (SIGTERM) 10:45:41.990434 run iperf3-srv_10.42.42.10(pid=30476): Terminating (SIGTERM) 10:45:42.029889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30479): Terminating (SIGTERM) 10:45:42.069873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30482): Terminating (SIGTERM) 10:45:42.109392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30485): Terminating (SIGTERM) 10:45:42.149165 --- ParallelTerminationStrategy: PID 30475 died... 10:45:42.167913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30475): Terminated: ok {rc=0} 10:45:42.211608 --- ParallelTerminationStrategy: PID 30476 died... 10:45:42.229998 run iperf3-srv_10.42.42.10(pid=30476): Terminated {rc=256} 10:45:42.273669 --- ParallelTerminationStrategy: PID 30479 died... 10:45:42.291878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30479): Terminated: ok {rc=0} 10:45:42.335206 --- ParallelTerminationStrategy: PID 30482 died... 10:45:42.353579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30482): Terminated: ok {rc=0} 10:45:42.397567 --- ParallelTerminationStrategy: PID 30485 died... 10:45:42.416194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30485): Terminated: ok {rc=0} 10:45:42.500673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:45:43.649825 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:43.662075 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:45:43.711213 tst iperf3m4.py: using LAC 27852 10:45:43.838919 tst iperf3m4.py: using RAC 57 10:45:43.965349 tst iperf3m4.py: using CellId 27852 10:45:44.092155 tst iperf3m4.py: using BVCI 27853 10:45:44.208465 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.220031 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.231343 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.243013 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.254671 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.266329 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.277951 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.289409 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:45:44.301297 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:45:44.425481 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:45:44.545537 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:45:44.662426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:45:44.777908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:45:44.979586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:45.279838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30487): Launched 10:45:45.541219 run iperf3-srv_10.42.42.10(pid=30488): Launched 10:45:45.654121 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:45:45.872199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:46.231676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30489): Launched 10:45:46.560698 run iperf3-srv_10.42.42.10(pid=30490): Launched 10:45:46.686568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:45:46.894761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:47.218519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30491): Launched 10:45:47.499668 run iperf3-srv_10.42.42.10(pid=30492): Launched 10:45:47.620250 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:45:47.836905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:45:48.158547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30493): Launched 10:45:48.437403 run iperf3-srv_10.42.42.10(pid=30494): Launched 10:45:48.557760 tst iperf3m4.py:8: start network... 10:45:48.774664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:45:49.272377 run create_hlr_db(pid=30495): Launched 10:45:49.395305 bus /gobi_6: Setting Powered False 10:45:50.458482 run create_hlr_db(pid=30495): Terminated: ok {rc=0} 10:45:50.905026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30497): Launched 10:45:51.225432 run osmo-hlr_10.42.42.2(pid=30498): Launched 10:45:51.348279 run osmo-stp_10.42.42.5: Starting osmo-stp 10:45:51.906726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30500): Launched 10:45:52.228440 run osmo-stp_10.42.42.5(pid=30501): Launched 10:45:52.352376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:45:52.905746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30503): Launched 10:45:53.028877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:45:53.299062 run patchelf(pid=30504): Launched 10:45:53.478547 run osmo-stp_10.42.42.5(pid=30501): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30501)] 10:45:53.615525 run osmo-stp_10.42.42.5(pid=30501): stdout: | (launched: 2022-12-10_10:45:52.169917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:53.753665 run osmo-stp_10.42.42.5(pid=30501): stderr: | 20221210104552363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104552363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104552363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104552363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104552364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104552364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104552364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:53.892778 run osmo-stp_10.42.42.5(pid=30501): stdout: | (launched: 2022-12-10_10:45:52.169917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:45:54.024912 run osmo-stp_10.42.42.5(pid=30501): stderr: | 20221210104552363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104552363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104552363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104552363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104552364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104552364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104552364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:45:54.181159 run patchelf(pid=30504): Terminating (SIGINT) 10:45:54.361909 run patchelf(pid=30504): Terminated: ok {rc=0} 10:45:54.491994 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30501): Process ended prematurely: osmo-stp_10.42.42.5(pid=30501) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30501)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 10:45:54.502238 tst iperf3m4.py:8: Test FAILED (10.9 sec) 10:45:54.531506 run osmo-hlr_10.42.42.2(pid=30498): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30498)] 10:45:54.581969 run osmo-hlr_10.42.42.2(pid=30498): stdout: | (launched: 2022-12-10_10:45:51.167168) 10:45:54.634122 run osmo-hlr_10.42.42.2(pid=30498): stderr: | 20221210104551364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104551364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104551364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104551364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104551364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104551365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104551376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104551385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104551385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104551385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:45:54.686623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30487): Terminating (SIGTERM) 10:45:54.728842 run iperf3-srv_10.42.42.10(pid=30488): Terminating (SIGTERM) 10:45:54.771603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30489): Terminating (SIGTERM) 10:45:54.814194 run iperf3-srv_10.42.42.10(pid=30490): Terminating (SIGTERM) 10:45:54.856587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30491): Terminating (SIGTERM) 10:45:54.898953 run iperf3-srv_10.42.42.10(pid=30492): Terminating (SIGTERM) 10:45:54.941184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30493): Terminating (SIGTERM) 10:45:54.983578 run iperf3-srv_10.42.42.10(pid=30494): Terminating (SIGTERM) 10:45:55.025896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30497): Terminating (SIGTERM) 10:45:55.068226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30500): Terminating (SIGTERM) 10:45:55.110491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30503): Terminating (SIGTERM) 10:45:55.152843 --- ParallelTerminationStrategy: PID 30487 died... 10:45:55.172903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30487): Terminated: ok {rc=0} 10:45:55.219996 --- ParallelTerminationStrategy: PID 30488 died... 10:45:55.239656 run iperf3-srv_10.42.42.10(pid=30488): Terminated {rc=256} 10:45:55.286412 --- ParallelTerminationStrategy: PID 30489 died... 10:45:55.306217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30489): Terminated: ok {rc=0} 10:45:55.352696 --- ParallelTerminationStrategy: PID 30490 died... 10:45:55.372131 run iperf3-srv_10.42.42.10(pid=30490): Terminated {rc=256} 10:45:55.418865 --- ParallelTerminationStrategy: PID 30491 died... 10:45:55.438395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30491): Terminated: ok {rc=0} 10:45:55.484851 --- ParallelTerminationStrategy: PID 30492 died... 10:45:55.504869 run iperf3-srv_10.42.42.10(pid=30492): Terminated {rc=256} 10:45:55.551533 --- ParallelTerminationStrategy: PID 30493 died... 10:45:55.571266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30493): Terminated: ok {rc=0} 10:45:55.617826 --- ParallelTerminationStrategy: PID 30494 died... 10:45:55.637494 run iperf3-srv_10.42.42.10(pid=30494): Terminated {rc=256} 10:45:55.684217 --- ParallelTerminationStrategy: PID 30497 died... 10:45:55.703915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30497): Terminated: ok {rc=0} 10:45:55.750557 --- ParallelTerminationStrategy: PID 30500 died... 10:45:55.770607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30500): Terminated: ok {rc=0} 10:45:55.817430 --- ParallelTerminationStrategy: PID 30503 died... 10:45:55.837110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30503): Terminated: ok {rc=0} 10:45:55.925415 bus /gobi_4: Setting Powered False 10:45:57.026557 bus /gobi_4: Setting Powered False 10:45:58.142678 bus /gobi_1: Setting Powered False 10:45:59.239314 bus /gobi_1: Setting Powered False 10:46:00.355772 bus /gobi_0: Setting Powered False 10:46:01.459198 bus /gobi_0: Setting Powered False 10:46:02.578636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 10:46:03.683100 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:03.694866 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:46:03.741842 tst ping.py: using LAC 27853 10:46:03.866791 tst ping.py: using RAC 58 10:46:03.989642 tst ping.py: using CellId 27853 10:46:04.114377 tst ping.py: using BVCI 27854 10:46:04.228780 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:04.240479 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:04.251798 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:04.263370 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:04.274845 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:04.286463 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:04.298169 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:04.309774 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:04.424540 tst ping.py:19: start network... 10:46:04.623136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:05.079034 run create_hlr_db(pid=30505): Launched 10:46:05.199608 bus /gobi_6: Setting Powered False 10:46:06.258571 run create_hlr_db(pid=30505): Terminated: ok {rc=0} 10:46:06.671505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30507): Launched 10:46:06.966519 run osmo-hlr_10.42.42.2(pid=30508): Launched 10:46:07.078235 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:07.602196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30510): Launched 10:46:07.896683 run osmo-stp_10.42.42.5(pid=30511): Launched 10:46:08.008015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:08.516845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30513): Launched 10:46:08.630163 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:08.879646 run patchelf(pid=30514): Launched 10:46:09.044407 run osmo-stp_10.42.42.5(pid=30511): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30511)] 10:46:09.169635 run osmo-stp_10.42.42.5(pid=30511): stdout: | (launched: 2022-12-10_10:46:07.842989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:09.296611 run osmo-stp_10.42.42.5(pid=30511): stderr: | 20221210104608015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104608016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104608016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104608016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104608017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104608017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104608017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:09.424228 run osmo-stp_10.42.42.5(pid=30511): stdout: | (launched: 2022-12-10_10:46:07.842989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:09.545403 run osmo-stp_10.42.42.5(pid=30511): stderr: | 20221210104608015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104608016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104608016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104608016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104608017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104608017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104608017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:09.688853 run patchelf(pid=30514): Terminating (SIGINT) 10:46:09.855220 run patchelf(pid=30514): Terminated: ok {rc=0} 10:46:09.975041 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30511): Process ended prematurely: osmo-stp_10.42.42.5(pid=30511) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30511)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 10:46:09.983809 tst ping.py:22: Test FAILED (6.3 sec) 10:46:10.010518 run osmo-hlr_10.42.42.2(pid=30508): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30508)] 10:46:10.057820 run osmo-hlr_10.42.42.2(pid=30508): stdout: | (launched: 2022-12-10_10:46:06.912581) 10:46:10.106829 run osmo-hlr_10.42.42.2(pid=30508): stderr: | 20221210104607087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104607087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104607087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104607087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104607087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104607087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104607099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104607108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104607108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104607109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:10.156343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30507): Terminating (SIGTERM) 10:46:10.196182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30510): Terminating (SIGTERM) 10:46:10.235764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30513): Terminating (SIGTERM) 10:46:10.275630 --- ParallelTerminationStrategy: PID 30507 died... 10:46:10.294747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30507): Terminated: ok {rc=0} 10:46:10.339202 --- ParallelTerminationStrategy: PID 30510 died... 10:46:10.357889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30510): Terminated: ok {rc=0} 10:46:10.401817 --- ParallelTerminationStrategy: PID 30513 died... 10:46:10.420576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30513): Terminated: ok {rc=0} 10:46:10.504870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:46:11.591504 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:11.604159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:46:11.654980 tst ping_idle_ping.py: using LAC 27854 10:46:11.776892 tst ping_idle_ping.py: using RAC 59 10:46:11.891797 tst ping_idle_ping.py: using CellId 27854 10:46:12.006714 tst ping_idle_ping.py: using BVCI 27855 10:46:12.115634 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:12.126918 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:12.137839 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:12.148705 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:12.159537 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:12.170363 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:12.181408 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:46:12.192206 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:46:12.310215 tst ping_idle_ping.py:24: start network... 10:46:12.524463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:13.015500 run create_hlr_db(pid=30515): Launched 10:46:13.136273 bus /gobi_6: Setting Powered False 10:46:14.199549 run create_hlr_db(pid=30515): Terminated: ok {rc=0} 10:46:14.626740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30517): Launched 10:46:14.922764 run osmo-hlr_10.42.42.2(pid=30518): Launched 10:46:15.036123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:15.540232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30520): Launched 10:46:15.837998 run osmo-stp_10.42.42.5(pid=30521): Launched 10:46:16.095218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:16.816352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30523): Launched 10:46:16.933498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:17.200687 run patchelf(pid=30524): Launched 10:46:17.385704 run osmo-stp_10.42.42.5(pid=30521): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30521)] 10:46:17.520871 run osmo-stp_10.42.42.5(pid=30521): stdout: | (launched: 2022-12-10_10:46:15.779224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:17.655997 run osmo-stp_10.42.42.5(pid=30521): stderr: | 20221210104616047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104616047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104616048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104616048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104616048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104616048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104616057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:17.791693 run osmo-stp_10.42.42.5(pid=30521): stdout: | (launched: 2022-12-10_10:46:15.779224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:17.920631 run osmo-stp_10.42.42.5(pid=30521): stderr: | 20221210104616047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104616047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104616048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104616048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104616048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104616048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104616057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:18.073389 run patchelf(pid=30524): Terminating (SIGINT) 10:46:18.249347 run patchelf(pid=30524): Terminated: ok {rc=0} 10:46:18.376723 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30521): Process ended prematurely: osmo-stp_10.42.42.5(pid=30521) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30521)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 10:46:18.386656 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 10:46:18.415803 run osmo-hlr_10.42.42.2(pid=30518): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30518)] 10:46:18.466238 run osmo-hlr_10.42.42.2(pid=30518): stdout: | (launched: 2022-12-10_10:46:14.868674) 10:46:18.518723 run osmo-hlr_10.42.42.2(pid=30518): stderr: | 20221210104615043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104615043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104615043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104615043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104615043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104615043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104615055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104615066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104615066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104615066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:18.571894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30517): Terminating (SIGTERM) 10:46:18.614534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30520): Terminating (SIGTERM) 10:46:18.656997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30523): Terminating (SIGTERM) 10:46:18.699799 --- ParallelTerminationStrategy: PID 30517 died... 10:46:18.719897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30517): Terminated: ok {rc=0} 10:46:18.767292 --- ParallelTerminationStrategy: PID 30520 died... 10:46:18.787321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30520): Terminated: ok {rc=0} 10:46:18.834734 --- ParallelTerminationStrategy: PID 30523 died... 10:46:18.854517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30523): Terminated: ok {rc=0} 10:46:18.943445 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:46:20.242244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:46:20.247968 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:46:20.277932 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:46:20.316129 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:46:20.402086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:46:20.430963 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:46:20.469280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:46:21.065286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:46:21.114387 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.125443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:46:21.191122 tst cs_paging_gprs_active.py: using LAC 27855 10:46:21.308522 tst cs_paging_gprs_active.py: using RAC 60 10:46:21.437573 tst cs_paging_gprs_active.py: using CellId 27855 10:46:21.555018 tst cs_paging_gprs_active.py: using BVCI 27856 10:46:21.664740 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.675697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.686530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.697979 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.709275 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.720352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.731672 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.742886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:21.754317 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:46:21.870153 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:46:21.988931 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:46:22.205690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:22.525628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30528): Launched 10:46:22.806173 run iperf3-srv_10.42.42.10(pid=30529): Launched 10:46:22.926487 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:46:23.143170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:23.463804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30530): Launched 10:46:23.742106 run iperf3-srv_10.42.42.10(pid=30531): Launched 10:46:23.862464 tst cs_paging_gprs_active.py:38: start network... 10:46:24.078155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:24.571231 run create_hlr_db(pid=30532): Launched 10:46:24.693469 bus /gobi_6: Setting Powered False 10:46:25.756468 run create_hlr_db(pid=30532): Terminated: ok {rc=0} 10:46:26.185189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30534): Launched 10:46:26.483385 run osmo-hlr_10.42.42.2(pid=30535): Launched 10:46:26.598561 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:27.118083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30537): Launched 10:46:27.415696 run osmo-stp_10.42.42.5(pid=30538): Launched 10:46:27.531770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:28.047485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30540): Launched 10:46:28.162340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:28.414711 run patchelf(pid=30541): Launched 10:46:28.581750 run osmo-stp_10.42.42.5(pid=30538): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30538)] 10:46:28.709794 run osmo-stp_10.42.42.5(pid=30538): stdout: | (launched: 2022-12-10_10:46:27.361608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:28.838543 run osmo-stp_10.42.42.5(pid=30538): stderr: | 20221210104627530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104627530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104627530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104627530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104627531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104627531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104627531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:28.967092 run osmo-stp_10.42.42.5(pid=30538): stdout: | (launched: 2022-12-10_10:46:27.361608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:29.089754 run osmo-stp_10.42.42.5(pid=30538): stderr: | 20221210104627530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104627530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104627530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104627530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104627531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104627531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104627531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:29.235272 run patchelf(pid=30541): Terminating (SIGINT) 10:46:29.403966 run patchelf(pid=30541): Terminated: ok {rc=0} 10:46:29.525517 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30538): Process ended prematurely: osmo-stp_10.42.42.5(pid=30538) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30538)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:46:29.534856 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:46:29.562000 run osmo-hlr_10.42.42.2(pid=30535): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30535)] 10:46:29.609425 run osmo-hlr_10.42.42.2(pid=30535): stdout: | (launched: 2022-12-10_10:46:26.429455) 10:46:29.658660 run osmo-hlr_10.42.42.2(pid=30535): stderr: | 20221210104626606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104626606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104626606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104626606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104626606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104626607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104626618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104626629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104626629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104626629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:29.708073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30528): Terminating (SIGTERM) 10:46:29.747599 run iperf3-srv_10.42.42.10(pid=30529): Terminating (SIGTERM) 10:46:29.787085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30530): Terminating (SIGTERM) 10:46:29.826684 run iperf3-srv_10.42.42.10(pid=30531): Terminating (SIGTERM) 10:46:29.866197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30534): Terminating (SIGTERM) 10:46:29.905733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30537): Terminating (SIGTERM) 10:46:29.945208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30540): Terminating (SIGTERM) 10:46:29.985100 --- ParallelTerminationStrategy: PID 30528 died... 10:46:30.003999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30528): Terminated: ok {rc=0} 10:46:30.047984 --- ParallelTerminationStrategy: PID 30529 died... 10:46:30.066378 run iperf3-srv_10.42.42.10(pid=30529): Terminated {rc=256} 10:46:30.110549 --- ParallelTerminationStrategy: PID 30530 died... 10:46:30.129023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30530): Terminated: ok {rc=0} 10:46:30.172486 --- ParallelTerminationStrategy: PID 30531 died... 10:46:30.190940 run iperf3-srv_10.42.42.10(pid=30531): Terminated {rc=256} 10:46:30.234492 --- ParallelTerminationStrategy: PID 30534 died... 10:46:30.252911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30534): Terminated: ok {rc=0} 10:46:30.296393 --- ParallelTerminationStrategy: PID 30537 died... 10:46:30.314927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30537): Terminated: ok {rc=0} 10:46:30.358465 --- ParallelTerminationStrategy: PID 30540 died... 10:46:30.376838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30540): Terminated: ok {rc=0} 10:46:30.462920 bus /gobi_0: Setting Powered False 10:46:31.574248 bus /gobi_0: Setting Powered False 10:46:32.709850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:46:33.856517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:33.868196 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:46:33.942918 tst iperf3.py: using LAC 27856 10:46:34.060152 tst iperf3.py: using RAC 61 10:46:34.175275 tst iperf3.py: using CellId 27856 10:46:34.290573 tst iperf3.py: using BVCI 27857 10:46:34.397925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.409021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.419952 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.430802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.441597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.452417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.463405 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.474157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:34.485062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:46:34.601904 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:46:34.803148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:35.105720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30542): Launched 10:46:35.383185 run iperf3-srv_10.42.42.10(pid=30543): Launched 10:46:35.502917 tst iperf3.py:8: start network... 10:46:35.717819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:36.209350 run create_hlr_db(pid=30544): Launched 10:46:36.331589 bus /gobi_6: Setting Powered False 10:46:37.390234 run create_hlr_db(pid=30544): Terminated: ok {rc=0} 10:46:37.835343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30546): Launched 10:46:38.153687 run osmo-hlr_10.42.42.2(pid=30547): Launched 10:46:38.275978 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:38.834989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30549): Launched 10:46:39.153356 run osmo-stp_10.42.42.5(pid=30550): Launched 10:46:39.275682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:39.827753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30552): Launched 10:46:39.950831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:40.219584 run patchelf(pid=30553): Launched 10:46:40.397360 run osmo-stp_10.42.42.5(pid=30550): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30550)] 10:46:40.532330 run osmo-stp_10.42.42.5(pid=30550): stdout: | (launched: 2022-12-10_10:46:39.095434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:40.669630 run osmo-stp_10.42.42.5(pid=30550): stderr: | 20221210104639285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104639285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104639285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104639285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104639288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104639288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104639288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:40.807487 run osmo-stp_10.42.42.5(pid=30550): stdout: | (launched: 2022-12-10_10:46:39.095434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:40.938678 run osmo-stp_10.42.42.5(pid=30550): stderr: | 20221210104639285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104639285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104639285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104639285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104639288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104639288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104639288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:41.093411 run patchelf(pid=30553): Terminating (SIGINT) 10:46:41.272867 run patchelf(pid=30553): Terminated: ok {rc=0} 10:46:41.402509 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30550): Process ended prematurely: osmo-stp_10.42.42.5(pid=30550) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30550)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 10:46:41.412661 tst iperf3.py:8: Test FAILED (7.6 sec) 10:46:41.441844 run osmo-hlr_10.42.42.2(pid=30547): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30547)] 10:46:41.491846 run osmo-hlr_10.42.42.2(pid=30547): stdout: | (launched: 2022-12-10_10:46:38.096463) 10:46:41.543684 run osmo-hlr_10.42.42.2(pid=30547): stderr: | 20221210104638291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104638291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104638291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104638291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104638291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104638291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104638308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104638318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104638318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104638318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:41.596168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30542): Terminating (SIGTERM) 10:46:41.638356 run iperf3-srv_10.42.42.10(pid=30543): Terminating (SIGTERM) 10:46:41.680682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30546): Terminating (SIGTERM) 10:46:41.722740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30549): Terminating (SIGTERM) 10:46:41.764630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30552): Terminating (SIGTERM) 10:46:41.807196 --- ParallelTerminationStrategy: PID 30542 died... 10:46:41.827087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30542): Terminated: ok {rc=0} 10:46:41.873839 --- ParallelTerminationStrategy: PID 30543 died... 10:46:41.893357 run iperf3-srv_10.42.42.10(pid=30543): Terminated {rc=256} 10:46:41.939989 --- ParallelTerminationStrategy: PID 30546 died... 10:46:41.959559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30546): Terminated: ok {rc=0} 10:46:42.006817 --- ParallelTerminationStrategy: PID 30549 died... 10:46:42.026407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30549): Terminated: ok {rc=0} 10:46:42.073523 --- ParallelTerminationStrategy: PID 30552 died... 10:46:42.093147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30552): Terminated: ok {rc=0} 10:46:42.181371 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:46:43.327703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.339463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:46:43.407186 tst iperf3m4.py: using LAC 27857 10:46:43.533140 tst iperf3m4.py: using RAC 62 10:46:43.656924 tst iperf3m4.py: using CellId 27857 10:46:43.780687 tst iperf3m4.py: using BVCI 27858 10:46:43.896546 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.908025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.919413 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.931169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.942719 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.954301 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.965946 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.977364 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:46:43.988847 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:46:44.109398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:46:44.230677 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:46:44.344033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:46:44.465908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:46:44.679851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:44.999916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30554): Launched 10:46:45.276492 run iperf3-srv_10.42.42.10(pid=30555): Launched 10:46:45.396024 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:46:45.610258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:45.936141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30556): Launched 10:46:46.218593 run iperf3-srv_10.42.42.10(pid=30557): Launched 10:46:46.353549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:46:46.572372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:46.902732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30558): Launched 10:46:47.188008 run iperf3-srv_10.42.42.10(pid=30559): Launched 10:46:47.301827 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:46:47.501446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:46:47.800100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30560): Launched 10:46:48.059623 run iperf3-srv_10.42.42.10(pid=30561): Launched 10:46:48.171226 tst iperf3m4.py:8: start network... 10:46:48.370376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:46:48.831868 run create_hlr_db(pid=30562): Launched 10:46:48.955327 bus /gobi_6: Setting Powered False 10:46:50.014951 run create_hlr_db(pid=30562): Terminated: ok {rc=0} 10:46:50.449674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30564): Launched 10:46:50.768303 run osmo-hlr_10.42.42.2(pid=30565): Launched 10:46:50.890477 run osmo-stp_10.42.42.5: Starting osmo-stp 10:46:51.442290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30567): Launched 10:46:51.761115 run osmo-stp_10.42.42.5(pid=30568): Launched 10:46:51.883509 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:46:52.431251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30570): Launched 10:46:52.553949 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:46:52.823200 run patchelf(pid=30571): Launched 10:46:53.001697 run osmo-stp_10.42.42.5(pid=30568): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30568)] 10:46:53.137078 run osmo-stp_10.42.42.5(pid=30568): stdout: | (launched: 2022-12-10_10:46:51.702717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:53.273915 run osmo-stp_10.42.42.5(pid=30568): stderr: | 20221210104651896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104651897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104651897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104651897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104651898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104651898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104651898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:53.410745 run osmo-stp_10.42.42.5(pid=30568): stdout: | (launched: 2022-12-10_10:46:51.702717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:46:53.541283 run osmo-stp_10.42.42.5(pid=30568): stderr: | 20221210104651896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104651897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104651897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104651897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104651898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104651898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104651898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:46:53.695949 run patchelf(pid=30571): Terminating (SIGINT) 10:46:53.875756 run patchelf(pid=30571): Terminated: ok {rc=0} 10:46:54.005393 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30568): Process ended prematurely: osmo-stp_10.42.42.5(pid=30568) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30568)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:46:54.015578 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:46:54.044889 run osmo-hlr_10.42.42.2(pid=30565): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30565)] 10:46:54.095310 run osmo-hlr_10.42.42.2(pid=30565): stdout: | (launched: 2022-12-10_10:46:50.710816) 10:46:54.147354 run osmo-hlr_10.42.42.2(pid=30565): stderr: | 20221210104650909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104650909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104650909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104650909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104650909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104650909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104650925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104650935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104650935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104650935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:46:54.199879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30554): Terminating (SIGTERM) 10:46:54.241927 run iperf3-srv_10.42.42.10(pid=30555): Terminating (SIGTERM) 10:46:54.284212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30556): Terminating (SIGTERM) 10:46:54.326461 run iperf3-srv_10.42.42.10(pid=30557): Terminating (SIGTERM) 10:46:54.368663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30558): Terminating (SIGTERM) 10:46:54.411348 run iperf3-srv_10.42.42.10(pid=30559): Terminating (SIGTERM) 10:46:54.453450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30560): Terminating (SIGTERM) 10:46:54.495550 run iperf3-srv_10.42.42.10(pid=30561): Terminating (SIGTERM) 10:46:54.537758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30564): Terminating (SIGTERM) 10:46:54.579897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30567): Terminating (SIGTERM) 10:46:54.622087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30570): Terminating (SIGTERM) 10:46:54.664292 --- ParallelTerminationStrategy: PID 30554 died... 10:46:54.684269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30554): Terminated: ok {rc=0} 10:46:54.730870 --- ParallelTerminationStrategy: PID 30555 died... 10:46:54.750388 run iperf3-srv_10.42.42.10(pid=30555): Terminated {rc=256} 10:46:54.797064 --- ParallelTerminationStrategy: PID 30556 died... 10:46:54.816402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30556): Terminated: ok {rc=0} 10:46:54.863259 --- ParallelTerminationStrategy: PID 30557 died... 10:46:54.882717 run iperf3-srv_10.42.42.10(pid=30557): Terminated {rc=256} 10:46:54.929259 --- ParallelTerminationStrategy: PID 30558 died... 10:46:54.948834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30558): Terminated: ok {rc=0} 10:46:54.995489 --- ParallelTerminationStrategy: PID 30559 died... 10:46:55.015030 run iperf3-srv_10.42.42.10(pid=30559): Terminated {rc=256} 10:46:55.061560 --- ParallelTerminationStrategy: PID 30560 died... 10:46:55.081188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30560): Terminated: ok {rc=0} 10:46:55.127937 --- ParallelTerminationStrategy: PID 30561 died... 10:46:55.147382 run iperf3-srv_10.42.42.10(pid=30561): Terminated {rc=256} 10:46:55.193950 --- ParallelTerminationStrategy: PID 30564 died... 10:46:55.213561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30564): Terminated: ok {rc=0} 10:46:55.260056 --- ParallelTerminationStrategy: PID 30567 died... 10:46:55.279552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30567): Terminated: ok {rc=0} 10:46:55.326357 --- ParallelTerminationStrategy: PID 30570 died... 10:46:55.345929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30570): Terminated: ok {rc=0} 10:46:55.434954 bus /gobi_4: Setting Powered False 10:46:56.533716 bus /gobi_4: Setting Powered False 10:46:57.647143 bus /gobi_1: Setting Powered False 10:46:58.744461 bus /gobi_1: Setting Powered False 10:46:59.859671 bus /gobi_0: Setting Powered False 10:47:00.969752 bus /gobi_0: Setting Powered False 10:47:02.091265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:47:03.197025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.209102 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:47:03.276283 tst ping.py: using LAC 27858 10:47:03.398386 tst ping.py: using RAC 63 10:47:03.520682 tst ping.py: using CellId 27858 10:47:03.643029 tst ping.py: using BVCI 27859 10:47:03.756787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.768350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.779685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.791266 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.802806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.814271 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.825690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:03.837827 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:03.955002 tst ping.py:19: start network... 10:47:04.166163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:04.649077 run create_hlr_db(pid=30572): Launched 10:47:04.767635 bus /gobi_6: Setting Powered False 10:47:05.829988 run create_hlr_db(pid=30572): Terminated: ok {rc=0} 10:47:06.249412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30574): Launched 10:47:06.542342 run osmo-hlr_10.42.42.2(pid=30575): Launched 10:47:06.654470 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:07.162410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30577): Launched 10:47:07.454402 run osmo-stp_10.42.42.5(pid=30578): Launched 10:47:07.566076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:08.070780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30580): Launched 10:47:08.182875 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:08.429257 run patchelf(pid=30581): Launched 10:47:08.592326 run osmo-stp_10.42.42.5(pid=30578): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30578)] 10:47:08.716276 run osmo-stp_10.42.42.5(pid=30578): stdout: | (launched: 2022-12-10_10:47:07.401392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:08.841965 run osmo-stp_10.42.42.5(pid=30578): stderr: | 20221210104707571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104707571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104707571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104707572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104707572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104707572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104707572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:08.968344 run osmo-stp_10.42.42.5(pid=30578): stdout: | (launched: 2022-12-10_10:47:07.401392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:09.088290 run osmo-stp_10.42.42.5(pid=30578): stderr: | 20221210104707571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104707571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104707571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104707572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104707572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104707572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104707572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:09.231086 run patchelf(pid=30581): Terminating (SIGINT) 10:47:09.396610 run patchelf(pid=30581): Terminated: ok {rc=0} 10:47:09.515427 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30578): Process ended prematurely: osmo-stp_10.42.42.5(pid=30578) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30578)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 10:47:09.524288 tst ping.py:22: Test FAILED (6.3 sec) 10:47:09.550879 run osmo-hlr_10.42.42.2(pid=30575): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30575)] 10:47:09.598199 run osmo-hlr_10.42.42.2(pid=30575): stdout: | (launched: 2022-12-10_10:47:06.489204) 10:47:09.646793 run osmo-hlr_10.42.42.2(pid=30575): stderr: | 20221210104706664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104706664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104706664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104706664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104706664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104706665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104706677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104706687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104706687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104706687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:09.695929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30574): Terminating (SIGTERM) 10:47:09.735303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30577): Terminating (SIGTERM) 10:47:09.774947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30580): Terminating (SIGTERM) 10:47:09.814934 --- ParallelTerminationStrategy: PID 30574 died... 10:47:09.834046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30574): Terminated: ok {rc=0} 10:47:09.878248 --- ParallelTerminationStrategy: PID 30577 died... 10:47:09.896772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30577): Terminated: ok {rc=0} 10:47:09.940793 --- ParallelTerminationStrategy: PID 30580 died... 10:47:09.959559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30580): Terminated: ok {rc=0} 10:47:10.046123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:47:11.135068 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.147159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:47:11.213782 tst ping_idle_ping.py: using LAC 27859 10:47:11.328827 tst ping_idle_ping.py: using RAC 64 10:47:11.446335 tst ping_idle_ping.py: using CellId 27859 10:47:11.566454 tst ping_idle_ping.py: using BVCI 27860 10:47:11.674653 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.685886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.696856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.707885 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.718710 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.729582 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.740463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:47:11.751363 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:47:11.864741 tst ping_idle_ping.py:24: start network... 10:47:12.078000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:12.540232 run create_hlr_db(pid=30582): Launched 10:47:12.661198 bus /gobi_6: Setting Powered False 10:47:13.720266 run create_hlr_db(pid=30582): Terminated: ok {rc=0} 10:47:14.150701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30584): Launched 10:47:14.464876 run osmo-hlr_10.42.42.2(pid=30585): Launched 10:47:14.586889 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:15.130753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30587): Launched 10:47:15.444910 run osmo-stp_10.42.42.5(pid=30588): Launched 10:47:15.566347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:16.112076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30590): Launched 10:47:16.236871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:16.505699 run patchelf(pid=30591): Launched 10:47:16.683768 run osmo-stp_10.42.42.5(pid=30588): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30588)] 10:47:16.811686 run osmo-stp_10.42.42.5(pid=30588): stdout: | (launched: 2022-12-10_10:47:15.388371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:16.940612 run osmo-stp_10.42.42.5(pid=30588): stderr: | 20221210104715577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104715577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104715577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104715578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104715578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104715578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104715578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:17.072050 run osmo-stp_10.42.42.5(pid=30588): stdout: | (launched: 2022-12-10_10:47:15.388371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:17.196061 run osmo-stp_10.42.42.5(pid=30588): stderr: | 20221210104715577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104715577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104715577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104715578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104715578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104715578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104715578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:17.338721 run patchelf(pid=30591): Terminating (SIGINT) 10:47:17.505231 run patchelf(pid=30591): Terminated: ok {rc=0} 10:47:17.625088 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30588): Process ended prematurely: osmo-stp_10.42.42.5(pid=30588) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30588)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:47:17.634008 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 10:47:17.661151 run osmo-hlr_10.42.42.2(pid=30585): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30585)] 10:47:17.708758 run osmo-hlr_10.42.42.2(pid=30585): stdout: | (launched: 2022-12-10_10:47:14.408291) 10:47:17.758139 run osmo-hlr_10.42.42.2(pid=30585): stderr: | 20221210104714602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104714602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104714602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104714602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104714602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104714602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104714614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104714623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104714623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104714623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:17.808115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30584): Terminating (SIGTERM) 10:47:17.848347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30587): Terminating (SIGTERM) 10:47:17.888306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30590): Terminating (SIGTERM) 10:47:17.928706 --- ParallelTerminationStrategy: PID 30584 died... 10:47:17.947926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30584): Terminated: ok {rc=0} 10:47:17.992340 --- ParallelTerminationStrategy: PID 30587 died... 10:47:18.011094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30587): Terminated: ok {rc=0} 10:47:18.055156 --- ParallelTerminationStrategy: PID 30590 died... 10:47:18.073995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30590): Terminated: ok {rc=0} 10:47:18.160177 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 10:47:19.469218 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:47:19.476743 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 10:47:19.507394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 10:47:19.548701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 10:47:19.641463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 10:47:19.671988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 10:47:19.712757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 10:47:20.306183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 10:47:20.358795 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.370344 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:47:20.437497 tst cs_paging_gprs_active.py: using LAC 27860 10:47:20.555168 tst cs_paging_gprs_active.py: using RAC 65 10:47:20.671595 tst cs_paging_gprs_active.py: using CellId 27860 10:47:20.788305 tst cs_paging_gprs_active.py: using BVCI 27861 10:47:20.908176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.919779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.931031 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.943045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.955413 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.967430 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.979416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:20.991266 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:21.003456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:47:21.123965 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:47:21.242589 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:47:21.458477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:21.778173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30596): Launched 10:47:22.056562 run iperf3-srv_10.42.42.10(pid=30597): Launched 10:47:22.176616 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:47:22.392367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:22.698581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30598): Launched 10:47:22.959802 run iperf3-srv_10.42.42.10(pid=30599): Launched 10:47:23.072926 tst cs_paging_gprs_active.py:38: start network... 10:47:23.273573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:23.735750 run create_hlr_db(pid=30600): Launched 10:47:23.858944 bus /gobi_6: Setting Powered False 10:47:24.919063 run create_hlr_db(pid=30600): Terminated: ok {rc=0} 10:47:25.336824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30602): Launched 10:47:25.634634 run osmo-hlr_10.42.42.2(pid=30603): Launched 10:47:25.748392 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:26.259202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30605): Launched 10:47:26.556631 run osmo-stp_10.42.42.5(pid=30606): Launched 10:47:26.670776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:27.184858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30608): Launched 10:47:27.299463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:27.557656 run patchelf(pid=30609): Launched 10:47:27.725177 run osmo-stp_10.42.42.5(pid=30606): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30606)] 10:47:27.852188 run osmo-stp_10.42.42.5(pid=30606): stdout: | (launched: 2022-12-10_10:47:26.502299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:27.980812 run osmo-stp_10.42.42.5(pid=30606): stderr: | 20221210104726674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104726674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104726674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104726675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104726675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104726675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104726675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:28.109735 run osmo-stp_10.42.42.5(pid=30606): stdout: | (launched: 2022-12-10_10:47:26.502299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:28.232378 run osmo-stp_10.42.42.5(pid=30606): stderr: | 20221210104726674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104726674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104726674 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104726675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104726675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104726675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104726675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:28.377854 run patchelf(pid=30609): Terminating (SIGINT) 10:47:28.547060 run patchelf(pid=30609): Terminated: ok {rc=0} 10:47:28.668853 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30606): Process ended prematurely: osmo-stp_10.42.42.5(pid=30606) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30606)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 10:47:28.678457 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 10:47:28.705507 run osmo-hlr_10.42.42.2(pid=30603): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30603)] 10:47:28.752704 run osmo-hlr_10.42.42.2(pid=30603): stdout: | (launched: 2022-12-10_10:47:25.580331) 10:47:28.801680 run osmo-hlr_10.42.42.2(pid=30603): stderr: | 20221210104725755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104725755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104725755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104725755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104725755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104725755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104725768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104725777 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104725777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104725777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:28.851237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30596): Terminating (SIGTERM) 10:47:28.891009 run iperf3-srv_10.42.42.10(pid=30597): Terminating (SIGTERM) 10:47:28.930668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30598): Terminating (SIGTERM) 10:47:28.970428 run iperf3-srv_10.42.42.10(pid=30599): Terminating (SIGTERM) 10:47:29.010099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30602): Terminating (SIGTERM) 10:47:29.049840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30605): Terminating (SIGTERM) 10:47:29.089744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30608): Terminating (SIGTERM) 10:47:29.130382 --- ParallelTerminationStrategy: PID 30596 died... 10:47:29.149402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30596): Terminated: ok {rc=0} 10:47:29.193593 --- ParallelTerminationStrategy: PID 30597 died... 10:47:29.212492 run iperf3-srv_10.42.42.10(pid=30597): Terminated {rc=256} 10:47:29.256171 --- ParallelTerminationStrategy: PID 30598 died... 10:47:29.274661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30598): Terminated: ok {rc=0} 10:47:29.318252 --- ParallelTerminationStrategy: PID 30599 died... 10:47:29.336836 run iperf3-srv_10.42.42.10(pid=30599): Terminated {rc=256} 10:47:29.380552 --- ParallelTerminationStrategy: PID 30602 died... 10:47:29.399286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30602): Terminated: ok {rc=0} 10:47:29.442828 --- ParallelTerminationStrategy: PID 30605 died... 10:47:29.461335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30605): Terminated: ok {rc=0} 10:47:29.505045 --- ParallelTerminationStrategy: PID 30608 died... 10:47:29.523629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30608): Terminated: ok {rc=0} 10:47:29.606598 bus /gobi_0: Setting Powered False 10:47:30.704126 bus /gobi_0: Setting Powered False 10:47:31.826686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 10:47:32.989422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.001636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:47:33.070183 tst iperf3.py: using LAC 27861 10:47:33.191535 tst iperf3.py: using RAC 66 10:47:33.310554 tst iperf3.py: using CellId 27861 10:47:33.432024 tst iperf3.py: using BVCI 27862 10:47:33.542161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.553424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.564462 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.576233 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.587832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.599281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.610988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.622540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:33.634404 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:47:33.750997 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:47:33.966742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:34.284934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30610): Launched 10:47:34.562184 run iperf3-srv_10.42.42.10(pid=30611): Launched 10:47:34.681561 tst iperf3.py:8: start network... 10:47:34.896356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:35.389018 run create_hlr_db(pid=30612): Launched 10:47:35.510828 bus /gobi_6: Setting Powered False 10:47:36.573959 run create_hlr_db(pid=30612): Terminated: ok {rc=0} 10:47:37.001146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30614): Launched 10:47:37.300142 run osmo-hlr_10.42.42.2(pid=30615): Launched 10:47:37.414590 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:37.930710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30617): Launched 10:47:38.228878 run osmo-stp_10.42.42.5(pid=30618): Launched 10:47:38.343700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:38.858100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30620): Launched 10:47:38.972381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:39.224174 run patchelf(pid=30621): Launched 10:47:39.390073 run osmo-stp_10.42.42.5(pid=30618): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30618)] 10:47:39.516584 run osmo-stp_10.42.42.5(pid=30618): stdout: | (launched: 2022-12-10_10:47:38.174713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:39.644786 run osmo-stp_10.42.42.5(pid=30618): stderr: | 20221210104738344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104738344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104738344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104738344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104738345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104738345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104738345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:39.773330 run osmo-stp_10.42.42.5(pid=30618): stdout: | (launched: 2022-12-10_10:47:38.174713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:39.895888 run osmo-stp_10.42.42.5(pid=30618): stderr: | 20221210104738344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104738344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104738344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104738344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104738345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104738345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104738345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:40.040394 run patchelf(pid=30621): Terminating (SIGINT) 10:47:40.207788 run patchelf(pid=30621): Terminated: ok {rc=0} 10:47:40.328793 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30618): Process ended prematurely: osmo-stp_10.42.42.5(pid=30618) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30618)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 10:47:40.338215 tst iperf3.py:8: Test FAILED (7.4 sec) 10:47:40.365116 run osmo-hlr_10.42.42.2(pid=30615): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30615)] 10:47:40.412343 run osmo-hlr_10.42.42.2(pid=30615): stdout: | (launched: 2022-12-10_10:47:37.245929) 10:47:40.461179 run osmo-hlr_10.42.42.2(pid=30615): stderr: | 20221210104737423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104737423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104737423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104737423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104737423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104737423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104737436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104737446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104737446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104737446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:40.510123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30610): Terminating (SIGTERM) 10:47:40.549236 run iperf3-srv_10.42.42.10(pid=30611): Terminating (SIGTERM) 10:47:40.588499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30614): Terminating (SIGTERM) 10:47:40.627815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30617): Terminating (SIGTERM) 10:47:40.667119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30620): Terminating (SIGTERM) 10:47:40.706613 --- ParallelTerminationStrategy: PID 30610 died... 10:47:40.725604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30610): Terminated: ok {rc=0} 10:47:40.769221 --- ParallelTerminationStrategy: PID 30611 died... 10:47:40.787464 run iperf3-srv_10.42.42.10(pid=30611): Terminated {rc=256} 10:47:40.831201 --- ParallelTerminationStrategy: PID 30614 died... 10:47:40.849532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30614): Terminated: ok {rc=0} 10:47:40.892724 --- ParallelTerminationStrategy: PID 30617 died... 10:47:40.911116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30617): Terminated: ok {rc=0} 10:47:40.954396 --- ParallelTerminationStrategy: PID 30620 died... 10:47:40.972747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30620): Terminated: ok {rc=0} 10:47:41.055582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 10:47:42.203522 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.215734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:47:42.285472 tst iperf3m4.py: using LAC 27862 10:47:42.410411 tst iperf3m4.py: using RAC 67 10:47:42.534768 tst iperf3m4.py: using CellId 27862 10:47:42.659274 tst iperf3m4.py: using BVCI 27863 10:47:42.774493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.786045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.797433 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.808859 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.820498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.832313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.844560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.856531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:47:42.868217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:47:42.985814 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:47:43.107660 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:47:43.224917 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:47:43.340348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:47:43.540213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:43.839690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30622): Launched 10:47:44.100737 run iperf3-srv_10.42.42.10(pid=30623): Launched 10:47:44.213189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:47:44.413232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:44.712880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30624): Launched 10:47:44.973332 run iperf3-srv_10.42.42.10(pid=30625): Launched 10:47:45.085597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:47:45.285884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:45.585709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30626): Launched 10:47:45.857894 run iperf3-srv_10.42.42.10(pid=30627): Launched 10:47:46.013604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:47:46.239572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:47:46.551982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30628): Launched 10:47:46.836872 run iperf3-srv_10.42.42.10(pid=30629): Launched 10:47:46.962863 tst iperf3m4.py:8: start network... 10:47:47.166439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:47:47.631732 run create_hlr_db(pid=30630): Launched 10:47:47.755501 bus /gobi_6: Setting Powered False 10:47:48.815127 run create_hlr_db(pid=30630): Terminated: ok {rc=0} 10:47:49.251966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30632): Launched 10:47:49.571760 run osmo-hlr_10.42.42.2(pid=30633): Launched 10:47:49.694257 run osmo-stp_10.42.42.5: Starting osmo-stp 10:47:50.250342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30635): Launched 10:47:50.569843 run osmo-stp_10.42.42.5(pid=30636): Launched 10:47:50.691630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:47:51.241353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30638): Launched 10:47:51.364675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:47:51.633569 run patchelf(pid=30639): Launched 10:47:51.811757 run osmo-stp_10.42.42.5(pid=30636): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30636)] 10:47:51.948312 run osmo-stp_10.42.42.5(pid=30636): stdout: | (launched: 2022-12-10_10:47:50.512181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:52.085923 run osmo-stp_10.42.42.5(pid=30636): stderr: | 20221210104750705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104750705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104750706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104750706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104750706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104750706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104750706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:52.223294 run osmo-stp_10.42.42.5(pid=30636): stdout: | (launched: 2022-12-10_10:47:50.512181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:47:52.354703 run osmo-stp_10.42.42.5(pid=30636): stderr: | 20221210104750705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104750705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104750706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104750706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104750706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104750706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104750706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:47:52.510789 run patchelf(pid=30639): Terminating (SIGINT) 10:47:52.690059 run patchelf(pid=30639): Terminated: ok {rc=0} 10:47:52.819439 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30636): Process ended prematurely: osmo-stp_10.42.42.5(pid=30636) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30636)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 10:47:52.830061 tst iperf3m4.py:8: Test FAILED (10.7 sec) 10:47:52.859384 run osmo-hlr_10.42.42.2(pid=30633): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30633)] 10:47:52.909565 run osmo-hlr_10.42.42.2(pid=30633): stdout: | (launched: 2022-12-10_10:47:49.514208) 10:47:52.961247 run osmo-hlr_10.42.42.2(pid=30633): stderr: | 20221210104749712 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104749712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104749713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104749713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104749713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104749713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104749725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104749733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104749733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104749733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:47:53.013259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30622): Terminating (SIGTERM) 10:47:53.055294 run iperf3-srv_10.42.42.10(pid=30623): Terminating (SIGTERM) 10:47:53.098640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30624): Terminating (SIGTERM) 10:47:53.140872 run iperf3-srv_10.42.42.10(pid=30625): Terminating (SIGTERM) 10:47:53.182678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30626): Terminating (SIGTERM) 10:47:53.224453 run iperf3-srv_10.42.42.10(pid=30627): Terminating (SIGTERM) 10:47:53.266117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30628): Terminating (SIGTERM) 10:47:53.307908 run iperf3-srv_10.42.42.10(pid=30629): Terminating (SIGTERM) 10:47:53.349784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30632): Terminating (SIGTERM) 10:47:53.391660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30635): Terminating (SIGTERM) 10:47:53.433513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30638): Terminating (SIGTERM) 10:47:53.475425 --- ParallelTerminationStrategy: PID 30622 died... 10:47:53.495383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30622): Terminated: ok {rc=0} 10:47:53.541769 --- ParallelTerminationStrategy: PID 30623 died... 10:47:53.560861 run iperf3-srv_10.42.42.10(pid=30623): Terminated {rc=256} 10:47:53.607204 --- ParallelTerminationStrategy: PID 30624 died... 10:47:53.626598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30624): Terminated: ok {rc=0} 10:47:53.672737 --- ParallelTerminationStrategy: PID 30625 died... 10:47:53.692111 run iperf3-srv_10.42.42.10(pid=30625): Terminated {rc=256} 10:47:53.738055 --- ParallelTerminationStrategy: PID 30626 died... 10:47:53.757439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30626): Terminated: ok {rc=0} 10:47:53.803433 --- ParallelTerminationStrategy: PID 30627 died... 10:47:53.822712 run iperf3-srv_10.42.42.10(pid=30627): Terminated {rc=256} 10:47:53.869107 --- ParallelTerminationStrategy: PID 30628 died... 10:47:53.888623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30628): Terminated: ok {rc=0} 10:47:53.934728 --- ParallelTerminationStrategy: PID 30629 died... 10:47:53.954104 run iperf3-srv_10.42.42.10(pid=30629): Terminated {rc=256} 10:47:54.000158 --- ParallelTerminationStrategy: PID 30632 died... 10:47:54.019557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30632): Terminated: ok {rc=0} 10:47:54.066115 --- ParallelTerminationStrategy: PID 30635 died... 10:47:54.085515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30635): Terminated: ok {rc=0} 10:47:54.131688 --- ParallelTerminationStrategy: PID 30638 died... 10:47:54.151074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30638): Terminated: ok {rc=0} 10:47:54.238524 bus /gobi_4: Setting Powered False 10:47:55.337184 bus /gobi_4: Setting Powered False 10:47:56.450042 bus /gobi_1: Setting Powered False 10:47:57.547986 bus /gobi_1: Setting Powered False 10:47:58.663634 bus /gobi_0: Setting Powered False 10:47:59.761089 bus /gobi_0: Setting Powered False 10:48:00.876428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 10:48:01.994779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.008191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:02.083878 tst ping.py: using LAC 27863 10:48:02.211295 tst ping.py: using RAC 68 10:48:02.335656 tst ping.py: using CellId 27863 10:48:02.458624 tst ping.py: using BVCI 27864 10:48:02.572552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.584269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.595855 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.607761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.619220 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.631232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.642869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:02.654403 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:02.768772 tst ping.py:19: start network... 10:48:02.966532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:03.420116 run create_hlr_db(pid=30640): Launched 10:48:03.541389 bus /gobi_6: Setting Powered False 10:48:04.600347 run create_hlr_db(pid=30640): Terminated: ok {rc=0} 10:48:05.030408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30642): Launched 10:48:05.343876 run osmo-hlr_10.42.42.2(pid=30643): Launched 10:48:05.464301 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:06.010904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30645): Launched 10:48:06.323606 run osmo-stp_10.42.42.5(pid=30646): Launched 10:48:06.443951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:06.985402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30648): Launched 10:48:07.106152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:07.371334 run patchelf(pid=30649): Launched 10:48:07.547364 run osmo-stp_10.42.42.5(pid=30646): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30646)] 10:48:07.680711 run osmo-stp_10.42.42.5(pid=30646): stdout: | (launched: 2022-12-10_10:48:06.266787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:07.815705 run osmo-stp_10.42.42.5(pid=30646): stderr: | 20221210104806456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104806456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104806456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104806457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104806459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104806459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104806459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:07.951566 run osmo-stp_10.42.42.5(pid=30646): stdout: | (launched: 2022-12-10_10:48:06.266787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:08.080376 run osmo-stp_10.42.42.5(pid=30646): stderr: | 20221210104806456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104806456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104806456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104806457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104806459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104806459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104806459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:08.233280 run patchelf(pid=30649): Terminating (SIGINT) 10:48:08.408863 run patchelf(pid=30649): Terminated: ok {rc=0} 10:48:08.535678 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30646): Process ended prematurely: osmo-stp_10.42.42.5(pid=30646) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30646)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 10:48:08.545226 tst ping.py:22: Test FAILED (6.5 sec) 10:48:08.573779 run osmo-hlr_10.42.42.2(pid=30643): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30643)] 10:48:08.623859 run osmo-hlr_10.42.42.2(pid=30643): stdout: | (launched: 2022-12-10_10:48:05.287260) 10:48:08.675520 run osmo-hlr_10.42.42.2(pid=30643): stderr: | 20221210104805487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104805487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104805487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104805487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104805488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104805488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104805500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104805508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104805508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104805508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:08.727702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30642): Terminating (SIGTERM) 10:48:08.769479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30645): Terminating (SIGTERM) 10:48:08.811578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30648): Terminating (SIGTERM) 10:48:08.854319 --- ParallelTerminationStrategy: PID 30642 died... 10:48:08.874479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30642): Terminated: ok {rc=0} 10:48:08.921390 --- ParallelTerminationStrategy: PID 30645 died... 10:48:08.941085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30645): Terminated: ok {rc=0} 10:48:08.987518 --- ParallelTerminationStrategy: PID 30648 died... 10:48:09.006990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30648): Terminated: ok {rc=0} 10:48:09.094252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 10:48:10.182498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.194697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 10:48:10.264137 tst ping_idle_ping.py: using LAC 27864 10:48:10.380022 tst ping_idle_ping.py: using RAC 69 10:48:10.500906 tst ping_idle_ping.py: using CellId 27864 10:48:10.617447 tst ping_idle_ping.py: using BVCI 27865 10:48:10.724168 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.735463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.746387 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.758017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.769455 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.780904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.792604 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 10:48:10.804345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 10:48:10.924172 tst ping_idle_ping.py:24: start network... 10:48:11.137450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:11.626288 run create_hlr_db(pid=30650): Launched 10:48:11.746539 bus /gobi_6: Setting Powered False 10:48:12.809936 run create_hlr_db(pid=30650): Terminated: ok {rc=0} 10:48:13.249664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Launched 10:48:13.563849 run osmo-hlr_10.42.42.2(pid=30653): Launched 10:48:13.683837 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:14.229974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Launched 10:48:14.542809 run osmo-stp_10.42.42.5(pid=30656): Launched 10:48:14.662674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:15.203964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Launched 10:48:15.324883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:15.589913 run patchelf(pid=30659): Launched 10:48:15.764866 run osmo-stp_10.42.42.5(pid=30656): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] 10:48:15.902344 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-10_10:48:14.485878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:16.040141 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221210104814676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104814676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104814676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104814676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104814679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104814679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104814679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:16.178408 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-10_10:48:14.485878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:16.310710 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221210104814676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104814676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104814676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104814676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104814679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104814679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104814679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:16.467500 run patchelf(pid=30659): Terminating (SIGINT) 10:48:16.647477 run patchelf(pid=30659): Terminated: ok {rc=0} 10:48:16.778079 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 10:48:16.788520 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:48:16.820487 run osmo-hlr_10.42.42.2(pid=30653): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30653)] 10:48:16.873380 run osmo-hlr_10.42.42.2(pid=30653): stdout: | (launched: 2022-12-10_10:48:13.506905) 10:48:16.927553 run osmo-hlr_10.42.42.2(pid=30653): stderr: | 20221210104813703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104813703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104813704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104813704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104813704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104813704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104813716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104813725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104813725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104813725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:16.982081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminating (SIGTERM) 10:48:17.026944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminating (SIGTERM) 10:48:17.072297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Terminating (SIGTERM) 10:48:17.116517 --- ParallelTerminationStrategy: PID 30652 died... 10:48:17.137137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminated: ok {rc=0} 10:48:17.186934 --- ParallelTerminationStrategy: PID 30655 died... 10:48:17.206683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminated: ok {rc=0} 10:48:17.253237 --- ParallelTerminationStrategy: PID 30658 died... 10:48:17.272716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30658): Terminated: ok {rc=0} 10:48:17.360767 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:48:18.659904 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:18.666426 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:48:18.695209 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:48:18.729525 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:48:18.783139 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:48:18.813159 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:48:18.847325 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:48:19.404066 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:48:19.408917 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:19.420300 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:48:19.488123 tst switch_tch_pdch.py: using LAC 27865 10:48:19.610215 tst switch_tch_pdch.py: using RAC 70 10:48:19.731295 tst switch_tch_pdch.py: using CellId 27865 10:48:19.856134 tst switch_tch_pdch.py: using BVCI 27866 10:48:19.970277 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:19.982263 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:19.994222 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:20.006142 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:20.018017 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:20.030035 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:20.042134 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:48:20.053958 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:48:20.169973 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:48:20.285703 tst switch_tch_pdch.py:51: start network... 10:48:20.480937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:20.934612 run create_hlr_db(pid=30663): Launched 10:48:21.055431 bus /gobi_6: Setting Powered False 10:48:22.115613 run create_hlr_db(pid=30663): Terminated: ok {rc=0} 10:48:22.545519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30665): Launched 10:48:22.860718 run osmo-hlr_10.42.42.2(pid=30666): Launched 10:48:22.980684 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:23.517486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30668): Launched 10:48:23.831165 run osmo-stp_10.42.42.5(pid=30669): Launched 10:48:23.951557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:24.492237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30671): Launched 10:48:24.612719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:24.877111 run patchelf(pid=30672): Launched 10:48:25.051471 run osmo-stp_10.42.42.5(pid=30669): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30669)] 10:48:25.184271 run osmo-stp_10.42.42.5(pid=30669): stdout: | (launched: 2022-12-10_10:48:23.774526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:25.319186 run osmo-stp_10.42.42.5(pid=30669): stderr: | 20221210104823964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104823964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104823964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104823965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104823967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104823967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104823967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:25.454188 run osmo-stp_10.42.42.5(pid=30669): stdout: | (launched: 2022-12-10_10:48:23.774526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:25.583018 run osmo-stp_10.42.42.5(pid=30669): stderr: | 20221210104823964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104823964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104823964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104823965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104823967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104823967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104823967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:25.735687 run patchelf(pid=30672): Terminating (SIGINT) 10:48:25.912052 run patchelf(pid=30672): Terminated: ok {rc=0} 10:48:26.038922 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30669): Process ended prematurely: osmo-stp_10.42.42.5(pid=30669) [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30669)] [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:48:26.048303 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:48:26.077117 run osmo-hlr_10.42.42.2(pid=30666): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30666)] 10:48:26.127213 run osmo-hlr_10.42.42.2(pid=30666): stdout: | (launched: 2022-12-10_10:48:22.803299) 10:48:26.179150 run osmo-hlr_10.42.42.2(pid=30666): stderr: | 20221210104823002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104823002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104823002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104823002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104823002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104823002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104823019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104823029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104823029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104823029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:26.231264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30665): Terminating (SIGTERM) 10:48:26.273075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30668): Terminating (SIGTERM) 10:48:26.315007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30671): Terminating (SIGTERM) 10:48:26.357266 --- ParallelTerminationStrategy: PID 30665 died... 10:48:26.377396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30665): Terminated: ok {rc=0} 10:48:26.424461 --- ParallelTerminationStrategy: PID 30668 died... 10:48:26.443939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30668): Terminated: ok {rc=0} 10:48:26.490547 --- ParallelTerminationStrategy: PID 30671 died... 10:48:26.510173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30671): Terminated: ok {rc=0} 10:48:26.597857 bus /gobi_0: Setting Powered False 10:48:27.696931 bus /gobi_0: Setting Powered False 10:48:28.811310 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 10:48:30.070497 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:30.076593 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 10:48:30.106957 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 10:48:30.142255 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 10:48:30.195349 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 10:48:30.224154 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 10:48:30.258493 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 10:48:30.816545 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 10:48:30.821588 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:30.835413 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 10:48:30.926263 tst switch_tch_pdch.py: using LAC 27866 10:48:31.047097 tst switch_tch_pdch.py: using RAC 71 10:48:31.170964 tst switch_tch_pdch.py: using CellId 27866 10:48:31.297718 tst switch_tch_pdch.py: using BVCI 27867 10:48:31.407162 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:31.418861 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:31.430434 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:31.442452 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:31.453840 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:31.466508 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:31.478239 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 10:48:31.489955 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:48:31.604872 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 10:48:31.724220 tst switch_tch_pdch.py:51: start network... 10:48:32.005884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:32.444443 run create_hlr_db(pid=30676): Launched 10:48:32.564644 bus /gobi_6: Setting Powered False 10:48:33.624471 run create_hlr_db(pid=30676): Terminated: ok {rc=0} 10:48:34.027486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30678): Launched 10:48:34.339544 run osmo-hlr_10.42.42.2(pid=30679): Launched 10:48:34.458728 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:34.970557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30681): Launched 10:48:35.282295 run osmo-stp_10.42.42.5(pid=30682): Launched 10:48:35.402027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:48:35.916223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30684): Launched 10:48:36.036779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:48:36.300247 run patchelf(pid=30685): Launched 10:48:36.474724 run osmo-stp_10.42.42.5(pid=30682): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30682)] 10:48:36.607424 run osmo-stp_10.42.42.5(pid=30682): stdout: | (launched: 2022-12-10_10:48:35.225863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:36.741667 run osmo-stp_10.42.42.5(pid=30682): stderr: | 20221210104835416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104835416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104835416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104835417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104835417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104835417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104835417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:36.876291 run osmo-stp_10.42.42.5(pid=30682): stdout: | (launched: 2022-12-10_10:48:35.225863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:37.004743 run osmo-stp_10.42.42.5(pid=30682): stderr: | 20221210104835416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104835416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104835416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104835417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104835417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104835417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104835417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:37.157401 run patchelf(pid=30685): Terminating (SIGINT) 10:48:37.333249 run patchelf(pid=30685): Terminated: ok {rc=0} 10:48:37.459998 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30682): Process ended prematurely: osmo-stp_10.42.42.5(pid=30682) [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30682)] [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 10:48:37.469566 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 10:48:37.498045 run osmo-hlr_10.42.42.2(pid=30679): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30679)] 10:48:37.548189 run osmo-hlr_10.42.42.2(pid=30679): stdout: | (launched: 2022-12-10_10:48:34.283236) 10:48:37.599932 run osmo-hlr_10.42.42.2(pid=30679): stderr: | 20221210104834480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104834480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104834480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104834480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104834480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104834480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104834493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104834501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104834501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104834501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:37.652290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30678): Terminating (SIGTERM) 10:48:37.694344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30681): Terminating (SIGTERM) 10:48:37.736395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30684): Terminating (SIGTERM) 10:48:37.778721 --- ParallelTerminationStrategy: PID 30678 died... 10:48:37.798549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30678): Terminated: ok {rc=0} 10:48:37.845248 --- ParallelTerminationStrategy: PID 30681 died... 10:48:37.864825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30681): Terminated: ok {rc=0} 10:48:37.911594 --- ParallelTerminationStrategy: PID 30684 died... 10:48:37.931094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30684): Terminated: ok {rc=0} 10:48:38.019135 bus /gobi_0: Setting Powered False 10:48:39.117721 bus /gobi_0: Setting Powered False 10:48:40.233597 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_sms:nanobts --------------------------------------------------------------------- 10:48:41.477550 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:41.481358 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 10:48:41.505001 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 10:48:41.512348 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 10:48:41.566078 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 10:48:41.590727 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 10:48:41.598216 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 10:48:42.130814 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 10:48:42.135979 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 10:48:42.146817 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 10:48:42.186063 tst mo_mt_sms.py: using LAC 27867 10:48:42.302353 tst mo_mt_sms.py: using RAC 72 10:48:42.419587 tst mo_mt_sms.py: using CellId 27867 10:48:42.537032 tst mo_mt_sms.py: using BVCI 27868 10:48:42.642825 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 10:48:42.759045 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 10:48:42.876787 tst mo_mt_sms.py:9: start nitb and bts... 10:48:43.087635 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:48:43.726153 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30689): Launched 10:48:44.038962 run osmo-nitb_10.42.42.2(pid=30690): Launched 10:48:44.212517 run osmo-nitb_10.42.42.2(pid=30690): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30690)] 10:48:44.353349 run osmo-nitb_10.42.42.2(pid=30690): stdout: | (launched: 2022-12-10_10:48:43.982705) 10:48:44.496187 run osmo-nitb_10.42.42.2(pid=30690): stderr: | (launched: 2022-12-10_10:48:44.029087) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:48:44.638812 run osmo-nitb_10.42.42.2(pid=30690): stdout: | (launched: 2022-12-10_10:48:43.982705) 10:48:44.775079 run osmo-nitb_10.42.42.2(pid=30690): stderr: | (launched: 2022-12-10_10:48:44.029087) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30690): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30690) [trial-2373↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30690)] 10:48:45.157514 tst osmo-nitb_10.42.42.2(pid=30690): stdout: | (launched: 2022-12-10_10:48:43.982705) 10:48:45.283834 tst osmo-nitb_10.42.42.2(pid=30690): stderr: | (launched: 2022-12-10_10:48:44.029087) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:48:45.433325 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30690): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30690) [trial-2373↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30690)] [trial-2373↪nitb_sms:nanobts↪mo_mt_sms.py:11] 10:48:45.442338 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 10:48:45.449436 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30689): Terminating (SIGTERM) 10:48:45.660296 --- ParallelTerminationStrategy: PID 30689 died... 10:48:45.681552 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30689): Terminated: ok {rc=0} 10:48:45.768496 bus /sierra_3: Setting Powered False 10:48:46.862880 bus /sierra_3: Setting Powered False 10:48:47.978508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:nanobts+band-1900 --------------------------------------------------------------------- 10:48:49.166902 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:49.172063 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:48:49.197388 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:48:49.225430 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 10:48:49.279870 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:48:49.304311 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:48:49.331658 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 10:48:49.880780 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 10:48:49.885919 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:48:49.896919 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:48:49.935218 tst mo_mt_sms.py: using LAC 27868 10:48:50.050654 tst mo_mt_sms.py: using RAC 73 10:48:50.167163 tst mo_mt_sms.py: using CellId 27868 10:48:50.287381 tst mo_mt_sms.py: using BVCI 27869 10:48:50.394475 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:48:50.405344 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:48:50.416019 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:48:50.426895 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:48:50.437671 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:48:50.448159 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 10:48:50.565652 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 10:48:50.678362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:48:51.131970 run create_hlr_db(pid=30694): Launched 10:48:51.252208 bus /sierra_2: Setting Powered False 10:48:52.311851 run create_hlr_db(pid=30694): Terminated: ok {rc=0} 10:48:52.721548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30696): Launched 10:48:53.016026 run osmo-hlr_10.42.42.2(pid=30697): Launched 10:48:53.129238 run osmo-stp_10.42.42.5: Starting osmo-stp 10:48:53.633109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30699): Launched 10:48:53.927019 run osmo-stp_10.42.42.5(pid=30700): Launched 10:48:54.038722 run osmo-msc_10.42.42.6: Starting osmo-msc 10:48:54.569996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30702): Launched 10:48:54.863390 run osmo-msc_10.42.42.6(pid=30703): Launched 10:48:55.027952 run osmo-stp_10.42.42.5(pid=30700): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30700)] 10:48:55.151977 run osmo-stp_10.42.42.5(pid=30700): stdout: | (launched: 2022-12-10_10:48:53.873644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:55.276139 run osmo-stp_10.42.42.5(pid=30700): stderr: | 20221210104854043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104854043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104854043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104854044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104854044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104854044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104854044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:55.398552 run osmo-stp_10.42.42.5(pid=30700): stdout: | (launched: 2022-12-10_10:48:53.873644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:48:55.515326 run osmo-stp_10.42.42.5(pid=30700): stderr: | 20221210104854043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104854043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104854043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104854044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104854044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104854044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104854044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:48:55.655213 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30700): Process ended prematurely: osmo-stp_10.42.42.5(pid=30700) [trial-2373↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30700)] [trial-2373↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 10:48:55.663588 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 10:48:55.689721 run osmo-hlr_10.42.42.2(pid=30697): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30697)] 10:48:55.737563 run osmo-hlr_10.42.42.2(pid=30697): stdout: | (launched: 2022-12-10_10:48:52.962211) 10:48:55.787263 run osmo-hlr_10.42.42.2(pid=30697): stderr: | 20221210104853140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104853140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104853140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104853140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104853140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104853140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104853153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104853163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104853163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104853163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:48:55.856452 run osmo-msc_10.42.42.6(pid=30703): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30703)] 10:48:55.903966 run osmo-msc_10.42.42.6(pid=30703): stdout: | (launched: 2022-12-10_10:48:54.809655) 10:48:55.952666 run osmo-msc_10.42.42.6(pid=30703): stderr: | 20221210104855078 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104855078 DLGLOBAL DEBUG validating counter group 0x7f5129de0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104855078 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104855078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104855078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104855079 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104855081 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104855082 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104855082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104855082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:48:56.002064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30696): Terminating (SIGTERM) 10:48:56.041421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30699): Terminating (SIGTERM) 10:48:56.080702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30702): Terminating (SIGTERM) 10:48:56.120256 --- ParallelTerminationStrategy: PID 30696 died... 10:48:56.139329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30696): Terminated: ok {rc=0} 10:48:56.182964 --- ParallelTerminationStrategy: PID 30699 died... 10:48:56.201538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30699): Terminated: ok {rc=0} 10:48:56.245122 --- ParallelTerminationStrategy: PID 30702 died... 10:48:56.263506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30702): Terminated: ok {rc=0} 10:48:56.348508 bus /sierra_3: Setting Powered False 10:48:57.447726 bus /sierra_3: Setting Powered False 10:48:58.560572 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 10:48:59.783307 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:48:59.788211 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:48:59.812785 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 10:48:59.820123 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 10:48:59.855951 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:48:59.881832 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 10:48:59.888772 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 10:49:00.407728 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 10:49:00.414397 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 10:49:00.425878 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:49:00.463521 tst assert_extension.py: using LAC 27869 10:49:00.579080 tst assert_extension.py: using RAC 74 10:49:00.707657 tst assert_extension.py: using CellId 27869 10:49:00.837299 tst assert_extension.py: using BVCI 27870 10:49:00.968112 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 10:49:01.091732 tst assert_extension.py:10: start nitb and bts... 10:49:01.293875 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:49:01.921496 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30709): Launched 10:49:02.223539 run osmo-nitb_10.42.42.2(pid=30710): Launched 10:49:02.386535 run osmo-nitb_10.42.42.2(pid=30710): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30710)] 10:49:02.519263 run osmo-nitb_10.42.42.2(pid=30710): stdout: | (launched: 2022-12-10_10:49:02.169236) 10:49:02.653513 run osmo-nitb_10.42.42.2(pid=30710): stderr: | (launched: 2022-12-10_10:49:02.214092) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:49:02.787669 run osmo-nitb_10.42.42.2(pid=30710): stdout: | (launched: 2022-12-10_10:49:02.169236) 10:49:02.916129 run osmo-nitb_10.42.42.2(pid=30710): stderr: | (launched: 2022-12-10_10:49:02.214092) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30710): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30710) [trial-2373↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30710)] 10:49:03.334125 tst osmo-nitb_10.42.42.2(pid=30710): stdout: | (launched: 2022-12-10_10:49:02.169236) 10:49:03.453305 tst osmo-nitb_10.42.42.2(pid=30710): stderr: | (launched: 2022-12-10_10:49:02.214092) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:49:03.592558 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30710): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30710) [trial-2373↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30710)] [trial-2373↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 10:49:03.600988 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:49:03.607555 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30709): Terminating (SIGTERM) 10:49:03.816126 --- ParallelTerminationStrategy: PID 30709 died... 10:49:03.836612 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30709): Terminated: ok {rc=0} 10:49:03.919710 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:nanobts+band-1900 --------------------------------------------------------------------- 10:49:05.083227 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:49:05.087884 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:49:05.111433 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:49:05.137931 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 10:49:05.172569 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:49:05.196175 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:49:05.222482 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 10:49:05.759126 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 10:49:05.765745 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:49:05.777604 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:49:05.817352 tst assert_extension.py: using LAC 27870 10:49:05.941194 tst assert_extension.py: using RAC 75 10:49:06.062300 tst assert_extension.py: using CellId 27870 10:49:06.183705 tst assert_extension.py: using BVCI 27871 10:49:06.297792 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:49:06.308771 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:49:06.319886 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:49:06.331084 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:49:06.342323 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:49:06.353631 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 10:49:06.468899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:06.953633 run create_hlr_db(pid=30714): Launched 10:49:07.073609 bus /sierra_2: Setting Powered False 10:49:08.136358 run create_hlr_db(pid=30714): Terminated: ok {rc=0} 10:49:08.571583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30716): Launched 10:49:08.884645 run osmo-hlr_10.42.42.2(pid=30717): Launched 10:49:09.005485 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:09.549986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30719): Launched 10:49:09.861707 run osmo-stp_10.42.42.5(pid=30720): Launched 10:49:09.982310 run osmo-msc_10.42.42.6: Starting osmo-msc 10:49:10.551568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30722): Launched 10:49:10.865106 run osmo-msc_10.42.42.6(pid=30723): Launched 10:49:11.040842 run osmo-stp_10.42.42.5(pid=30720): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30720)] 10:49:11.173441 run osmo-stp_10.42.42.5(pid=30720): stdout: | (launched: 2022-12-10_10:49:09.805258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:11.306611 run osmo-stp_10.42.42.5(pid=30720): stderr: | 20221210104909997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104909997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104909998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104909998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104909998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104909998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104909998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:11.438502 run osmo-stp_10.42.42.5(pid=30720): stdout: | (launched: 2022-12-10_10:49:09.805258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:11.563555 run osmo-stp_10.42.42.5(pid=30720): stderr: | 20221210104909997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104909997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104909998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104909998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104909998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104909998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104909998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:11.712632 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30720): Process ended prematurely: osmo-stp_10.42.42.5(pid=30720) [trial-2373↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30720)] [trial-2373↪ussd:nanobts+band-1900↪assert_extension.py:17] 10:49:11.721492 tst assert_extension.py:17: Test FAILED (5.9 sec) 10:49:11.749389 run osmo-hlr_10.42.42.2(pid=30717): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30717)] 10:49:11.799336 run osmo-hlr_10.42.42.2(pid=30717): stdout: | (launched: 2022-12-10_10:49:08.827727) 10:49:11.851060 run osmo-hlr_10.42.42.2(pid=30717): stderr: | 20221210104909024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104909024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104909024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104909024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104909024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104909025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104909037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104909045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104909045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104909045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:11.923967 run osmo-msc_10.42.42.6(pid=30723): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30723)] 10:49:11.975312 run osmo-msc_10.42.42.6(pid=30723): stdout: | (launched: 2022-12-10_10:49:10.808403) 10:49:12.027043 run osmo-msc_10.42.42.6(pid=30723): stderr: | 20221210104911129 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104911129 DLGLOBAL DEBUG validating counter group 0x7f530b07cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104911129 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104911129 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104911129 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104911129 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104911131 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104911131 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104911132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104911132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:49:12.079315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30716): Terminating (SIGTERM) 10:49:12.121055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30719): Terminating (SIGTERM) 10:49:12.162844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30722): Terminating (SIGTERM) 10:49:12.204936 --- ParallelTerminationStrategy: PID 30716 died... 10:49:12.224780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30716): Terminated: ok {rc=0} 10:49:12.271172 --- ParallelTerminationStrategy: PID 30719 died... 10:49:12.290486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30719): Terminated: ok {rc=0} 10:49:12.336725 --- ParallelTerminationStrategy: PID 30722 died... 10:49:12.356137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30722): Terminated: ok {rc=0} 10:49:12.443065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:49:13.641229 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:49:13.648333 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:49:13.671937 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:49:13.698275 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:49:13.751453 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:49:13.775113 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:49:13.801371 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:49:14.351593 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:49:14.399631 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:14.410993 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:49:14.469974 tst mo_mt_call.py: using LAC 27871 10:49:14.586511 tst mo_mt_call.py: using RAC 76 10:49:14.704466 tst mo_mt_call.py: using CellId 27871 10:49:14.821982 tst mo_mt_call.py: using BVCI 27872 10:49:14.930659 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:14.941962 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:14.952926 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:14.963953 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:14.975034 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:14.986086 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:49:15.103139 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:49:15.221236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:15.681666 run create_hlr_db(pid=30728): Launched 10:49:15.803248 bus /sierra_2: Setting Powered False 10:49:16.866653 run create_hlr_db(pid=30728): Terminated: ok {rc=0} 10:49:17.307076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Launched 10:49:17.606124 run osmo-hlr_10.42.42.2(pid=30731): Launched 10:49:17.719646 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:18.232033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Launched 10:49:18.529960 run osmo-stp_10.42.42.5(pid=30734): Launched 10:49:18.644134 run osmo-msc_10.42.42.6: Starting osmo-msc 10:49:19.184378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Launched 10:49:19.483426 run osmo-msc_10.42.42.6(pid=30737): Launched 10:49:19.649602 run osmo-stp_10.42.42.5(pid=30734): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] 10:49:19.776587 run osmo-stp_10.42.42.5(pid=30734): stdout: | (launched: 2022-12-10_10:49:18.475543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:19.902928 run osmo-stp_10.42.42.5(pid=30734): stderr: | 20221210104918645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104918645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104918645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104918646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104918648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104918648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104918648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:20.028156 run osmo-stp_10.42.42.5(pid=30734): stdout: | (launched: 2022-12-10_10:49:18.475543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:20.146886 run osmo-stp_10.42.42.5(pid=30734): stderr: | 20221210104918645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104918645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104918645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104918646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104918648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104918648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104918648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:20.289105 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30734): Process ended prematurely: osmo-stp_10.42.42.5(pid=30734) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:49:20.297883 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 10:49:20.324081 run osmo-hlr_10.42.42.2(pid=30731): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30731)] 10:49:20.371414 run osmo-hlr_10.42.42.2(pid=30731): stdout: | (launched: 2022-12-10_10:49:17.551767) 10:49:20.420569 run osmo-hlr_10.42.42.2(pid=30731): stderr: | 20221210104917727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104917727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104917727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104917727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104917727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104917727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104917746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104917756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104917756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104917756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:20.489323 run osmo-msc_10.42.42.6(pid=30737): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30737)] 10:49:20.536579 run osmo-msc_10.42.42.6(pid=30737): stdout: | (launched: 2022-12-10_10:49:19.429285) 10:49:20.586049 run osmo-msc_10.42.42.6(pid=30737): stderr: | 20221210104919701 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104919702 DLGLOBAL DEBUG validating counter group 0x7eff44f72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104919702 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104919702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104919702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104919702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104919704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104919704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104919704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104919704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:49:20.635142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Terminating (SIGTERM) 10:49:20.674235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Terminating (SIGTERM) 10:49:20.713400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Terminating (SIGTERM) 10:49:20.753398 --- ParallelTerminationStrategy: PID 30730 died... 10:49:20.772260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30730): Terminated: ok {rc=0} 10:49:20.816289 --- ParallelTerminationStrategy: PID 30733 died... 10:49:20.834846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30733): Terminated: ok {rc=0} 10:49:20.878282 --- ParallelTerminationStrategy: PID 30736 died... 10:49:20.896643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30736): Terminated: ok {rc=0} 10:49:20.982310 bus /sierra_3: Setting Powered False 10:49:22.081119 bus /sierra_3: Setting Powered False 10:49:23.192827 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:49:24.339238 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:24.351515 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:49:24.414669 tst mo_mt_call_osmux.py: using LAC 27872 10:49:24.540732 tst mo_mt_call_osmux.py: using RAC 77 10:49:24.669133 tst mo_mt_call_osmux.py: using CellId 27872 10:49:24.794013 tst mo_mt_call_osmux.py: using BVCI 27873 10:49:24.911729 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:24.923587 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:24.935024 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:24.947188 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:24.958971 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:49:24.970904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:49:25.088918 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:49:25.210424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:25.674263 run create_hlr_db(pid=30739): Launched 10:49:25.796372 bus /sierra_2: Setting Powered False 10:49:26.856912 run create_hlr_db(pid=30739): Terminated: ok {rc=0} 10:49:27.273862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30741): Launched 10:49:27.573444 run osmo-hlr_10.42.42.2(pid=30742): Launched 10:49:27.686757 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:28.215910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30744): Launched 10:49:28.515175 run osmo-stp_10.42.42.5(pid=30745): Launched 10:49:28.629649 run osmo-msc_10.42.42.6: Starting osmo-msc 10:49:29.170259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30747): Launched 10:49:29.468289 run osmo-msc_10.42.42.6(pid=30748): Launched 10:49:29.635143 run osmo-stp_10.42.42.5(pid=30745): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30745)] 10:49:29.762148 run osmo-stp_10.42.42.5(pid=30745): stdout: | (launched: 2022-12-10_10:49:28.460408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:29.889483 run osmo-stp_10.42.42.5(pid=30745): stderr: | 20221210104928630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104928630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104928631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104928631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104928633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104928633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104928633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:30.013754 run osmo-stp_10.42.42.5(pid=30745): stdout: | (launched: 2022-12-10_10:49:28.460408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:30.132743 run osmo-stp_10.42.42.5(pid=30745): stderr: | 20221210104928630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104928630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104928631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104928631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104928633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104928633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104928633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:30.274552 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30745): Process ended prematurely: osmo-stp_10.42.42.5(pid=30745) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30745)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:49:30.283304 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:49:30.309393 run osmo-hlr_10.42.42.2(pid=30742): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30742)] 10:49:30.356475 run osmo-hlr_10.42.42.2(pid=30742): stdout: | (launched: 2022-12-10_10:49:27.518969) 10:49:30.405384 run osmo-hlr_10.42.42.2(pid=30742): stderr: | 20221210104927697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104927697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104927697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104927697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104927697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104927697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104927710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104927718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104927718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104927718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:30.473538 run osmo-msc_10.42.42.6(pid=30748): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30748)] 10:49:30.520484 run osmo-msc_10.42.42.6(pid=30748): stdout: | (launched: 2022-12-10_10:49:29.413697) 10:49:30.569105 run osmo-msc_10.42.42.6(pid=30748): stderr: | 20221210104929689 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104929689 DLGLOBAL DEBUG validating counter group 0x7feb8de84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104929689 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104929689 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104929689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104929689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104929691 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104929691 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104929692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104929692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:49:30.617730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30741): Terminating (SIGTERM) 10:49:30.657117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30744): Terminating (SIGTERM) 10:49:30.696146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30747): Terminating (SIGTERM) 10:49:30.735553 --- ParallelTerminationStrategy: PID 30741 died... 10:49:30.754426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30741): Terminated: ok {rc=0} 10:49:30.798403 --- ParallelTerminationStrategy: PID 30744 died... 10:49:30.816645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30744): Terminated: ok {rc=0} 10:49:30.865544 --- ParallelTerminationStrategy: PID 30747 died... 10:49:30.891396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30747): Terminated: ok {rc=0} 10:49:30.975905 bus /sierra_3: Setting Powered False 10:49:32.081704 bus /sierra_3: Setting Powered False 10:49:33.217944 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:49:34.456244 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:49:34.463386 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:49:34.486747 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:49:34.513114 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:49:34.565788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:49:34.589814 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:49:34.615943 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:49:35.166889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:49:35.214670 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:35.225836 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:49:35.289548 tst mo_mt_call.py: using LAC 27873 10:49:35.406504 tst mo_mt_call.py: using RAC 78 10:49:35.523914 tst mo_mt_call.py: using CellId 27873 10:49:35.639571 tst mo_mt_call.py: using BVCI 27874 10:49:35.746923 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:35.758097 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:35.769110 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:35.780206 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:35.791323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:35.802402 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:49:35.920664 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:49:36.039223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:36.532200 run create_hlr_db(pid=30754): Launched 10:49:36.654867 bus /sierra_2: Setting Powered False 10:49:37.718279 run create_hlr_db(pid=30754): Terminated: ok {rc=0} 10:49:38.145610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Launched 10:49:38.445159 run osmo-hlr_10.42.42.2(pid=30757): Launched 10:49:38.559797 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:39.075817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Launched 10:49:39.374854 run osmo-stp_10.42.42.5(pid=30760): Launched 10:49:39.488706 run osmo-msc_10.42.42.6: Starting osmo-msc 10:49:40.030296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Launched 10:49:40.330177 run osmo-msc_10.42.42.6(pid=30763): Launched 10:49:40.497487 run osmo-stp_10.42.42.5(pid=30760): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] 10:49:40.624138 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-10_10:49:39.320403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:40.750836 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221210104939490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104939490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104939490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104939491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104939491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104939491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104939491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:40.875590 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-10_10:49:39.320403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:40.994852 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221210104939490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104939490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104939490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104939491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104939491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104939491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104939491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:41.137371 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:49:41.146121 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:49:41.172481 run osmo-hlr_10.42.42.2(pid=30757): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30757)] 10:49:41.220006 run osmo-hlr_10.42.42.2(pid=30757): stdout: | (launched: 2022-12-10_10:49:38.390592) 10:49:41.269214 run osmo-hlr_10.42.42.2(pid=30757): stderr: | 20221210104938566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104938566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104938566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104938566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104938566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104938566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104938577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104938585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104938585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104938585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:41.337601 run osmo-msc_10.42.42.6(pid=30763): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30763)] 10:49:41.384649 run osmo-msc_10.42.42.6(pid=30763): stdout: | (launched: 2022-12-10_10:49:40.275462) 10:49:41.433994 run osmo-msc_10.42.42.6(pid=30763): stderr: | 20221210104940545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104940545 DLGLOBAL DEBUG validating counter group 0x7f4558b60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104940545 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104940545 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104940545 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104940546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104940548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104940549 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104940549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104940549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:49:41.483285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminating (SIGTERM) 10:49:41.522564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminating (SIGTERM) 10:49:41.562223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Terminating (SIGTERM) 10:49:41.602057 --- ParallelTerminationStrategy: PID 30756 died... 10:49:41.621016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminated: ok {rc=0} 10:49:41.664450 --- ParallelTerminationStrategy: PID 30759 died... 10:49:41.682912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminated: ok {rc=0} 10:49:41.726208 --- ParallelTerminationStrategy: PID 30762 died... 10:49:41.744628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30762): Terminated: ok {rc=0} 10:49:41.827325 bus /sierra_3: Setting Powered False 10:49:42.922596 bus /sierra_3: Setting Powered False 10:49:44.035287 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:49:45.176020 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:45.187601 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:49:45.247482 tst mo_mt_call_osmux.py: using LAC 27874 10:49:45.364368 tst mo_mt_call_osmux.py: using RAC 79 10:49:45.483293 tst mo_mt_call_osmux.py: using CellId 27874 10:49:45.602389 tst mo_mt_call_osmux.py: using BVCI 27875 10:49:45.711765 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:45.722974 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:45.733999 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:45.745045 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:45.756138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:49:45.767130 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:49:45.906046 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:49:46.042329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:46.567148 run create_hlr_db(pid=30765): Launched 10:49:46.720889 bus /sierra_2: Setting Powered False 10:49:47.781238 run create_hlr_db(pid=30765): Terminated: ok {rc=0} 10:49:48.217902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Launched 10:49:48.537296 run osmo-hlr_10.42.42.2(pid=30768): Launched 10:49:48.661296 run osmo-stp_10.42.42.5: Starting osmo-stp 10:49:49.212324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Launched 10:49:49.531183 run osmo-stp_10.42.42.5(pid=30771): Launched 10:49:49.654621 run osmo-msc_10.42.42.6: Starting osmo-msc 10:49:50.232218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30773): Launched 10:49:50.553035 run osmo-msc_10.42.42.6(pid=30774): Launched 10:49:50.733329 run osmo-stp_10.42.42.5(pid=30771): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] 10:49:50.869153 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-10_10:49:49.473692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:51.006192 run osmo-stp_10.42.42.5(pid=30771): stderr: | 20221210104949666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104949666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104949666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104949666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104949667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104949667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104949667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:51.141737 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-10_10:49:49.473692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:49:51.269497 run osmo-stp_10.42.42.5(pid=30771): stderr: | 20221210104949666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210104949666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210104949666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210104949666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210104949667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210104949667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210104949667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:49:51.421908 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30771): Process ended prematurely: osmo-stp_10.42.42.5(pid=30771) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:49:51.431692 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 10:49:51.460661 run osmo-hlr_10.42.42.2(pid=30768): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30768)] 10:49:51.511369 run osmo-hlr_10.42.42.2(pid=30768): stdout: | (launched: 2022-12-10_10:49:48.479810) 10:49:51.563888 run osmo-hlr_10.42.42.2(pid=30768): stderr: | 20221210104948675 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104948675 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104948675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104948675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104948675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104948675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104948688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104948698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104948698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104948698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:49:51.636792 run osmo-msc_10.42.42.6(pid=30774): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30774)] 10:49:51.687613 run osmo-msc_10.42.42.6(pid=30774): stdout: | (launched: 2022-12-10_10:49:50.495280) 10:49:51.739915 run osmo-msc_10.42.42.6(pid=30774): stderr: | 20221210104950817 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210104950817 DLGLOBAL DEBUG validating counter group 0x7f21b7272c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210104950817 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210104950817 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210104950817 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210104950818 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210104950819 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210104950820 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210104950820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210104950820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:49:51.792725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminating (SIGTERM) 10:49:51.834949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminating (SIGTERM) 10:49:51.876866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30773): Terminating (SIGTERM) 10:49:51.919482 --- ParallelTerminationStrategy: PID 30767 died... 10:49:51.939336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminated: ok {rc=0} 10:49:51.985463 --- ParallelTerminationStrategy: PID 30770 died... 10:49:52.004734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminated: ok {rc=0} 10:49:52.050541 --- ParallelTerminationStrategy: PID 30773 died... 10:49:52.069906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30773): Terminated: ok {rc=0} 10:49:52.157710 bus /sierra_3: Setting Powered False 10:49:53.256030 bus /sierra_3: Setting Powered False 10:49:54.370582 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:49:55.610026 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:49:55.618624 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:49:55.642528 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:49:55.669700 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:49:55.722381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:49:55.746226 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:49:55.772498 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:49:56.323959 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:49:56.372519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:49:56.383799 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:49:56.442619 tst mo_mt_call.py: using LAC 27875 10:49:56.559926 tst mo_mt_call.py: using RAC 80 10:49:56.677721 tst mo_mt_call.py: using CellId 27875 10:49:56.798411 tst mo_mt_call.py: using BVCI 27876 10:49:56.908774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:49:56.920005 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:49:56.930959 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:49:56.942181 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:49:56.953511 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:49:56.964530 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:49:57.078026 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:49:57.194653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:49:57.656702 run create_hlr_db(pid=30779): Launched 10:49:57.781659 bus /sierra_2: Setting Powered False 10:49:58.845263 run create_hlr_db(pid=30779): Terminated: ok {rc=0} 10:49:59.271595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Launched 10:49:59.569436 run osmo-hlr_10.42.42.2(pid=30782): Launched 10:49:59.685460 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:00.201628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Launched 10:50:00.501014 run osmo-stp_10.42.42.5(pid=30785): Launched 10:50:00.615605 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:01.213718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30787): Launched 10:50:01.566719 run osmo-msc_10.42.42.6(pid=30791): Launched 10:50:01.871793 run osmo-stp_10.42.42.5(pid=30785): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] 10:50:02.105528 run osmo-stp_10.42.42.5(pid=30785): stdout: | (launched: 2022-12-10_10:50:00.446843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:02.244558 run osmo-stp_10.42.42.5(pid=30785): stderr: | 20221210105000617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105000617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105000618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105000618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105000619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105000619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105000619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:02.388458 run osmo-stp_10.42.42.5(pid=30785): stdout: | (launched: 2022-12-10_10:50:00.446843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:02.517878 run osmo-stp_10.42.42.5(pid=30785): stderr: | 20221210105000617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105000617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105000618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105000618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105000619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105000619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105000619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:02.670529 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30785): Process ended prematurely: osmo-stp_10.42.42.5(pid=30785) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:50:02.679957 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 10:50:02.708440 run osmo-hlr_10.42.42.2(pid=30782): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30782)] 10:50:02.758762 run osmo-hlr_10.42.42.2(pid=30782): stdout: | (launched: 2022-12-10_10:49:59.515577) 10:50:02.810951 run osmo-hlr_10.42.42.2(pid=30782): stderr: | 20221210104959691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210104959691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210104959691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210104959691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210104959691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210104959691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210104959703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210104959712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210104959712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210104959712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:02.883915 run osmo-msc_10.42.42.6(pid=30791): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30791)] 10:50:02.934548 run osmo-msc_10.42.42.6(pid=30791): stdout: | (launched: 2022-12-10_10:50:01.486986) 10:50:02.986879 run osmo-msc_10.42.42.6(pid=30791): stderr: | 20221210105002047 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105002048 DLGLOBAL DEBUG validating counter group 0x7f25bdd7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105002048 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105002048 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105002048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105002048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105002050 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105002050 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105002050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105002050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:03.039668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Terminating (SIGTERM) 10:50:03.081671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Terminating (SIGTERM) 10:50:03.123925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30787): Terminating (SIGTERM) 10:50:03.166443 --- ParallelTerminationStrategy: PID 30781 died... 10:50:03.186503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Terminated: ok {rc=0} 10:50:03.233592 --- ParallelTerminationStrategy: PID 30784 died... 10:50:03.253213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Terminated: ok {rc=0} 10:50:03.300137 --- ParallelTerminationStrategy: PID 30787 died... 10:50:03.319848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30787): Terminated: ok {rc=0} 10:50:03.408196 bus /sierra_3: Setting Powered False 10:50:04.506452 bus /sierra_3: Setting Powered False 10:50:05.621399 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:50:06.769576 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:50:06.781731 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:50:06.843074 tst mo_mt_call_osmux.py: using LAC 27876 10:50:06.973091 tst mo_mt_call_osmux.py: using RAC 81 10:50:07.097867 tst mo_mt_call_osmux.py: using CellId 27876 10:50:07.225402 tst mo_mt_call_osmux.py: using BVCI 27877 10:50:07.341467 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:50:07.353175 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:50:07.364684 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:50:07.376557 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:50:07.388411 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:50:07.400125 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:50:07.517735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:50:07.632466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:08.096532 run create_hlr_db(pid=30793): Launched 10:50:08.219755 bus /sierra_2: Setting Powered False 10:50:09.280433 run create_hlr_db(pid=30793): Terminated: ok {rc=0} 10:50:09.717565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30795): Launched 10:50:10.039188 run osmo-hlr_10.42.42.2(pid=30796): Launched 10:50:10.161232 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:10.715663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30798): Launched 10:50:11.035181 run osmo-stp_10.42.42.5(pid=30799): Launched 10:50:11.157202 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:11.740254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30801): Launched 10:50:12.061544 run osmo-msc_10.42.42.6(pid=30802): Launched 10:50:12.240521 run osmo-stp_10.42.42.5(pid=30799): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30799)] 10:50:12.375840 run osmo-stp_10.42.42.5(pid=30799): stdout: | (launched: 2022-12-10_10:50:10.977446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:12.512565 run osmo-stp_10.42.42.5(pid=30799): stderr: | 20221210105011167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105011167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105011167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105011168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105011168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105011168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105011168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:12.647833 run osmo-stp_10.42.42.5(pid=30799): stdout: | (launched: 2022-12-10_10:50:10.977446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:12.775480 run osmo-stp_10.42.42.5(pid=30799): stderr: | 20221210105011167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105011167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105011167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105011168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105011168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105011168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105011168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:12.928228 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30799): Process ended prematurely: osmo-stp_10.42.42.5(pid=30799) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30799)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:50:12.937833 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:50:12.966296 run osmo-hlr_10.42.42.2(pid=30796): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30796)] 10:50:13.016180 run osmo-hlr_10.42.42.2(pid=30796): stdout: | (launched: 2022-12-10_10:50:09.981444) 10:50:13.067877 run osmo-hlr_10.42.42.2(pid=30796): stderr: | 20221210105010180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105010180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105010180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105010180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105010180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105010180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105010192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105010201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105010201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105010201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:13.139955 run osmo-msc_10.42.42.6(pid=30802): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30802)] 10:50:13.189952 run osmo-msc_10.42.42.6(pid=30802): stdout: | (launched: 2022-12-10_10:50:12.003916) 10:50:13.241474 run osmo-msc_10.42.42.6(pid=30802): stderr: | 20221210105012322 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105012322 DLGLOBAL DEBUG validating counter group 0x7f337520ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105012322 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105012322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105012323 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105012323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105012324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105012325 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105012325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105012325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:13.293517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30795): Terminating (SIGTERM) 10:50:13.335335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30798): Terminating (SIGTERM) 10:50:13.377575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30801): Terminating (SIGTERM) 10:50:13.419673 --- ParallelTerminationStrategy: PID 30795 died... 10:50:13.439561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30795): Terminated: ok {rc=0} 10:50:13.485854 --- ParallelTerminationStrategy: PID 30798 died... 10:50:13.505304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30798): Terminated: ok {rc=0} 10:50:13.551485 --- ParallelTerminationStrategy: PID 30801 died... 10:50:13.571032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30801): Terminated: ok {rc=0} 10:50:13.658853 bus /sierra_3: Setting Powered False 10:50:14.757114 bus /sierra_3: Setting Powered False 10:50:15.876918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:50:17.164853 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:17.172844 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:50:17.199640 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:50:17.228668 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:50:17.280424 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:50:17.304815 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:50:17.332553 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:50:17.883726 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:50:17.932315 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:17.943751 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:50:18.003077 tst mo_mt_call.py: using LAC 27877 10:50:18.121583 tst mo_mt_call.py: using RAC 82 10:50:18.238872 tst mo_mt_call.py: using CellId 27877 10:50:18.356749 tst mo_mt_call.py: using BVCI 27878 10:50:18.465724 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:18.476788 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:18.487759 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:18.498973 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:18.510223 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:18.521351 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:50:18.639295 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:50:18.756104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:19.219329 run create_hlr_db(pid=30807): Launched 10:50:19.341702 bus /sierra_2: Setting Powered False 10:50:20.401686 run create_hlr_db(pid=30807): Terminated: ok {rc=0} 10:50:20.837670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30809): Launched 10:50:21.156698 run osmo-hlr_10.42.42.2(pid=30810): Launched 10:50:21.278707 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:21.803281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30812): Launched 10:50:22.102918 run osmo-stp_10.42.42.5(pid=30813): Launched 10:50:22.216690 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:22.756903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30815): Launched 10:50:23.056486 run osmo-msc_10.42.42.6(pid=30816): Launched 10:50:23.223809 run osmo-stp_10.42.42.5(pid=30813): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30813)] 10:50:23.350516 run osmo-stp_10.42.42.5(pid=30813): stdout: | (launched: 2022-12-10_10:50:22.048669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:23.476487 run osmo-stp_10.42.42.5(pid=30813): stderr: | 20221210105022221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105022221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105022221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105022221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105022222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105022222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105022222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:23.601076 run osmo-stp_10.42.42.5(pid=30813): stdout: | (launched: 2022-12-10_10:50:22.048669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:23.721246 run osmo-stp_10.42.42.5(pid=30813): stderr: | 20221210105022221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105022221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105022221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105022221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105022222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105022222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105022222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:23.863283 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30813): Process ended prematurely: osmo-stp_10.42.42.5(pid=30813) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30813)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:50:23.872299 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:50:23.898992 run osmo-hlr_10.42.42.2(pid=30810): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30810)] 10:50:23.946801 run osmo-hlr_10.42.42.2(pid=30810): stdout: | (launched: 2022-12-10_10:50:21.099327) 10:50:23.996145 run osmo-hlr_10.42.42.2(pid=30810): stderr: | 20221210105021295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105021295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105021295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105021295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105021295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105021296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105021307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105021315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105021315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105021315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:24.064811 run osmo-msc_10.42.42.6(pid=30816): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30816)] 10:50:24.112261 run osmo-msc_10.42.42.6(pid=30816): stdout: | (launched: 2022-12-10_10:50:23.001924) 10:50:24.161301 run osmo-msc_10.42.42.6(pid=30816): stderr: | 20221210105023272 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105023273 DLGLOBAL DEBUG validating counter group 0x7fe729db7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105023273 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105023273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105023273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105023273 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105023275 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105023275 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105023276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105023276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:24.210872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30809): Terminating (SIGTERM) 10:50:24.250390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30812): Terminating (SIGTERM) 10:50:24.290016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30815): Terminating (SIGTERM) 10:50:24.330146 --- ParallelTerminationStrategy: PID 30809 died... 10:50:24.349354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30809): Terminated: ok {rc=0} 10:50:24.393564 --- ParallelTerminationStrategy: PID 30812 died... 10:50:24.412241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30812): Terminated: ok {rc=0} 10:50:24.456241 --- ParallelTerminationStrategy: PID 30815 died... 10:50:24.475058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30815): Terminated: ok {rc=0} 10:50:24.559515 bus /sierra_3: Setting Powered False 10:50:25.654577 bus /sierra_3: Setting Powered False 10:50:26.768735 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:50:27.914163 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:27.926173 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:50:27.986670 tst mo_mt_call_osmux.py: using LAC 27878 10:50:28.105367 tst mo_mt_call_osmux.py: using RAC 83 10:50:28.224772 tst mo_mt_call_osmux.py: using CellId 27878 10:50:28.346734 tst mo_mt_call_osmux.py: using BVCI 27879 10:50:28.456206 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:28.467612 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:28.478632 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:28.489742 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:28.500867 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:50:28.511993 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:50:28.626897 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:50:28.745029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:29.239690 run create_hlr_db(pid=30818): Launched 10:50:29.362063 bus /sierra_2: Setting Powered False 10:50:30.426073 run create_hlr_db(pid=30818): Terminated: ok {rc=0} 10:50:30.865738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30820): Launched 10:50:31.215634 run osmo-hlr_10.42.42.2(pid=30821): Launched 10:50:31.354941 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:32.078626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30823): Launched 10:50:32.407169 run osmo-stp_10.42.42.5(pid=30824): Launched 10:50:32.529897 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:33.109290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30826): Launched 10:50:33.428346 run osmo-msc_10.42.42.6(pid=30827): Launched 10:50:33.606959 run osmo-stp_10.42.42.5(pid=30824): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30824)] 10:50:33.741669 run osmo-stp_10.42.42.5(pid=30824): stdout: | (launched: 2022-12-10_10:50:32.349790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:33.877398 run osmo-stp_10.42.42.5(pid=30824): stderr: | 20221210105032537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105032537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105032538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105032538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105032538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105032538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105032538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:34.012481 run osmo-stp_10.42.42.5(pid=30824): stdout: | (launched: 2022-12-10_10:50:32.349790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:34.139677 run osmo-stp_10.42.42.5(pid=30824): stderr: | 20221210105032537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105032537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105032538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105032538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105032538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105032538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105032538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:34.291436 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30824): Process ended prematurely: osmo-stp_10.42.42.5(pid=30824) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30824)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:50:34.301030 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:50:34.329579 run osmo-hlr_10.42.42.2(pid=30821): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30821)] 10:50:34.380008 run osmo-hlr_10.42.42.2(pid=30821): stdout: | (launched: 2022-12-10_10:50:31.149303) 10:50:34.432269 run osmo-hlr_10.42.42.2(pid=30821): stderr: | 20221210105031512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105031512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105031512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105031513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105031513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105031513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105031527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105031543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105031543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105031544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:34.505164 run osmo-msc_10.42.42.6(pid=30827): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30827)] 10:50:34.555501 run osmo-msc_10.42.42.6(pid=30827): stdout: | (launched: 2022-12-10_10:50:33.370537) 10:50:34.607697 run osmo-msc_10.42.42.6(pid=30827): stderr: | 20221210105033692 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105033693 DLGLOBAL DEBUG validating counter group 0x7f37a799cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105033693 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105033693 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105033693 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105033693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105033695 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105033695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105033695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105033696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:34.659879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30820): Terminating (SIGTERM) 10:50:34.701706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30823): Terminating (SIGTERM) 10:50:34.743551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30826): Terminating (SIGTERM) 10:50:34.785679 --- ParallelTerminationStrategy: PID 30820 died... 10:50:34.805591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30820): Terminated: ok {rc=0} 10:50:34.852195 --- ParallelTerminationStrategy: PID 30823 died... 10:50:34.871678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30823): Terminated: ok {rc=0} 10:50:34.918472 --- ParallelTerminationStrategy: PID 30826 died... 10:50:34.937909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30826): Terminated: ok {rc=0} 10:50:35.026374 bus /sierra_3: Setting Powered False 10:50:36.125418 bus /sierra_3: Setting Powered False 10:50:37.241224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:50:38.480660 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:38.487985 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:50:38.511871 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:50:38.538662 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:50:38.591767 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:50:38.616251 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:50:38.644189 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:50:39.193676 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:50:39.242854 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:39.254241 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:50:39.314213 tst mo_mt_call.py: using LAC 27879 10:50:39.430755 tst mo_mt_call.py: using RAC 84 10:50:39.550747 tst mo_mt_call.py: using CellId 27879 10:50:39.667098 tst mo_mt_call.py: using BVCI 27880 10:50:39.774747 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:39.786092 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:39.797300 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:39.808532 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:39.819956 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:39.831212 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:39.949312 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:40.068255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:40.562188 run create_hlr_db(pid=30832): Launched 10:50:40.686591 bus /sierra_2: Setting Powered False 10:50:41.749468 run create_hlr_db(pid=30832): Terminated: ok {rc=0} 10:50:42.176304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30834): Launched 10:50:42.476307 run osmo-hlr_10.42.42.2(pid=30835): Launched 10:50:42.591167 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:43.121658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30837): Launched 10:50:43.420544 run osmo-stp_10.42.42.5(pid=30838): Launched 10:50:43.535079 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:44.078380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30840): Launched 10:50:44.377839 run osmo-msc_10.42.42.6(pid=30841): Launched 10:50:44.545926 run osmo-stp_10.42.42.5(pid=30838): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30838)] 10:50:44.673212 run osmo-stp_10.42.42.5(pid=30838): stdout: | (launched: 2022-12-10_10:50:43.366287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:44.799915 run osmo-stp_10.42.42.5(pid=30838): stderr: | 20221210105043535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105043535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105043536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105043536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105043536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105043537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105043537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:44.924791 run osmo-stp_10.42.42.5(pid=30838): stdout: | (launched: 2022-12-10_10:50:43.366287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:45.043474 run osmo-stp_10.42.42.5(pid=30838): stderr: | 20221210105043535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105043535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105043536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105043536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105043536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105043537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105043537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:45.186400 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30838): Process ended prematurely: osmo-stp_10.42.42.5(pid=30838) [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30838)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:50:45.195183 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 10:50:45.221629 run osmo-hlr_10.42.42.2(pid=30835): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30835)] 10:50:45.269255 run osmo-hlr_10.42.42.2(pid=30835): stdout: | (launched: 2022-12-10_10:50:42.422106) 10:50:45.318646 run osmo-hlr_10.42.42.2(pid=30835): stderr: | 20221210105042599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105042599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105042599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105042599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105042599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105042599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105042612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105042622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105042622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105042622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:45.387658 run osmo-msc_10.42.42.6(pid=30841): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30841)] 10:50:45.435550 run osmo-msc_10.42.42.6(pid=30841): stdout: | (launched: 2022-12-10_10:50:44.323110) 10:50:45.484422 run osmo-msc_10.42.42.6(pid=30841): stderr: | 20221210105044592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105044593 DLGLOBAL DEBUG validating counter group 0x7f49d1fcac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105044593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105044593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105044593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105044593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105044596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105044596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105044596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105044597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:45.533792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30834): Terminating (SIGTERM) 10:50:45.573181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30837): Terminating (SIGTERM) 10:50:45.612398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30840): Terminating (SIGTERM) 10:50:45.652034 --- ParallelTerminationStrategy: PID 30834 died... 10:50:45.670967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30834): Terminated: ok {rc=0} 10:50:45.714679 --- ParallelTerminationStrategy: PID 30837 died... 10:50:45.733136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30837): Terminated: ok {rc=0} 10:50:45.776460 --- ParallelTerminationStrategy: PID 30840 died... 10:50:45.794978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30840): Terminated: ok {rc=0} 10:50:45.882336 bus /sierra_3: Setting Powered False 10:50:46.997751 bus /sierra_3: Setting Powered False 10:50:48.131472 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:50:49.280127 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:49.292655 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:50:49.356058 tst mo_mt_call_osmux.py: using LAC 27880 10:50:49.481975 tst mo_mt_call_osmux.py: using RAC 85 10:50:49.607929 tst mo_mt_call_osmux.py: using CellId 27880 10:50:49.734021 tst mo_mt_call_osmux.py: using BVCI 27881 10:50:49.852738 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:49.864421 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:49.875925 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:49.887899 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:49.900101 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:50:49.911947 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:50.031432 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:50:50.151637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:50:50.645685 run create_hlr_db(pid=30843): Launched 10:50:50.767353 bus /sierra_2: Setting Powered False 10:50:51.830685 run create_hlr_db(pid=30843): Terminated: ok {rc=0} 10:50:52.275536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30845): Launched 10:50:52.594558 run osmo-hlr_10.42.42.2(pid=30846): Launched 10:50:52.716488 run osmo-stp_10.42.42.5: Starting osmo-stp 10:50:53.269713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30848): Launched 10:50:53.589089 run osmo-stp_10.42.42.5(pid=30849): Launched 10:50:53.712348 run osmo-msc_10.42.42.6: Starting osmo-msc 10:50:54.290911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30851): Launched 10:50:54.611494 run osmo-msc_10.42.42.6(pid=30852): Launched 10:50:54.790349 run osmo-stp_10.42.42.5(pid=30849): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30849)] 10:50:54.925378 run osmo-stp_10.42.42.5(pid=30849): stdout: | (launched: 2022-12-10_10:50:53.531533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:55.061376 run osmo-stp_10.42.42.5(pid=30849): stderr: | 20221210105053721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105053721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105053722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105053722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105053724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105053725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105053725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:55.196799 run osmo-stp_10.42.42.5(pid=30849): stdout: | (launched: 2022-12-10_10:50:53.531533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:50:55.324482 run osmo-stp_10.42.42.5(pid=30849): stderr: | 20221210105053721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105053721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105053722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105053722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105053724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105053725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105053725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:50:55.476875 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30849): Process ended prematurely: osmo-stp_10.42.42.5(pid=30849) [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30849)] [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:50:55.486466 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:50:55.514893 run osmo-hlr_10.42.42.2(pid=30846): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30846)] 10:50:55.565068 run osmo-hlr_10.42.42.2(pid=30846): stdout: | (launched: 2022-12-10_10:50:52.536679) 10:50:55.616456 run osmo-hlr_10.42.42.2(pid=30846): stderr: | 20221210105052737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105052737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105052737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105052737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105052737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105052737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105052749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105052757 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105052758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105052758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:50:55.688344 run osmo-msc_10.42.42.6(pid=30852): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30852)] 10:50:55.738342 run osmo-msc_10.42.42.6(pid=30852): stdout: | (launched: 2022-12-10_10:50:54.553763) 10:50:55.789728 run osmo-msc_10.42.42.6(pid=30852): stderr: | 20221210105054874 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105054874 DLGLOBAL DEBUG validating counter group 0x7f9eab321c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105054874 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105054875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105054875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105054875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105054877 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105054877 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105054877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105054877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:50:55.841743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30845): Terminating (SIGTERM) 10:50:55.883461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30848): Terminating (SIGTERM) 10:50:55.925596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30851): Terminating (SIGTERM) 10:50:55.967573 --- ParallelTerminationStrategy: PID 30845 died... 10:50:55.987502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30845): Terminated: ok {rc=0} 10:50:56.033900 --- ParallelTerminationStrategy: PID 30848 died... 10:50:56.053420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30848): Terminated: ok {rc=0} 10:50:56.099733 --- ParallelTerminationStrategy: PID 30851 died... 10:50:56.119339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30851): Terminated: ok {rc=0} 10:50:56.207149 bus /sierra_3: Setting Powered False 10:50:57.306400 bus /sierra_3: Setting Powered False 10:50:58.421539 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:nanobts+band-1900 --------------------------------------------------------------------- 10:50:59.664509 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:50:59.670300 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:50:59.694871 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 10:50:59.722470 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 10:50:59.808554 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:50:59.832811 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 10:50:59.860994 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 10:51:00.443887 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 10:51:00.449161 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:00.459892 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:00.501128 tst emergency_mo_mt_call.py: using LAC 27881 10:51:00.616486 tst emergency_mo_mt_call.py: using RAC 86 10:51:00.731123 tst emergency_mo_mt_call.py: using CellId 27881 10:51:00.847564 tst emergency_mo_mt_call.py: using BVCI 27882 10:51:00.974266 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:00.985889 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:00.997526 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:01.008830 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:01.020388 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:01.031886 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:01.170885 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:01.322103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:01.851076 run create_hlr_db(pid=30857): Launched 10:51:02.007082 bus /sierra_2: Setting Powered False 10:51:03.064836 run create_hlr_db(pid=30857): Terminated: ok {rc=0} 10:51:03.476290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Launched 10:51:03.769474 run osmo-hlr_10.42.42.2(pid=30860): Launched 10:51:03.881456 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:04.401789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Launched 10:51:04.694812 run osmo-stp_10.42.42.5(pid=30863): Launched 10:51:04.815751 tst emergency_mo_mt_call.py: using MSISDN 7691 10:51:04.964639 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:05.492512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30865): Launched 10:51:05.785974 run osmo-msc_10.42.42.6(pid=30866): Launched 10:51:05.950610 run osmo-stp_10.42.42.5(pid=30863): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] 10:51:06.074088 run osmo-stp_10.42.42.5(pid=30863): stdout: | (launched: 2022-12-10_10:51:04.641260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:06.198260 run osmo-stp_10.42.42.5(pid=30863): stderr: | 20221210105104811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105104812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105104812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105104812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105104813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105104814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105104814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:06.320400 run osmo-stp_10.42.42.5(pid=30863): stdout: | (launched: 2022-12-10_10:51:04.641260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:06.437625 run osmo-stp_10.42.42.5(pid=30863): stderr: | 20221210105104811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105104812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105104812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105104812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105104813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105104814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105104814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:06.577544 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30863): Process ended prematurely: osmo-stp_10.42.42.5(pid=30863) [trial-2373↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] [trial-2373↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 10:51:06.586226 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 10:51:06.612278 run osmo-hlr_10.42.42.2(pid=30860): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30860)] 10:51:06.659678 run osmo-hlr_10.42.42.2(pid=30860): stdout: | (launched: 2022-12-10_10:51:03.716103) 10:51:06.708593 run osmo-hlr_10.42.42.2(pid=30860): stderr: | 20221210105103888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105103888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105103888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105103889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105103889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105103889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105103901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105103910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105103910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105103910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:06.777185 run osmo-msc_10.42.42.6(pid=30866): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30866)] 10:51:06.824507 run osmo-msc_10.42.42.6(pid=30866): stdout: | (launched: 2022-12-10_10:51:05.732223) 10:51:06.874070 run osmo-msc_10.42.42.6(pid=30866): stderr: | 20221210105106003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105106003 DLGLOBAL DEBUG validating counter group 0x7fd702de9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105106003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105106003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105106003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105106003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105106005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105106006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105106006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105106006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:06.923251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Terminating (SIGTERM) 10:51:06.962881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Terminating (SIGTERM) 10:51:07.002626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30865): Terminating (SIGTERM) 10:51:07.042387 --- ParallelTerminationStrategy: PID 30859 died... 10:51:07.061544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Terminated: ok {rc=0} 10:51:07.105556 --- ParallelTerminationStrategy: PID 30862 died... 10:51:07.124079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Terminated: ok {rc=0} 10:51:07.167987 --- ParallelTerminationStrategy: PID 30865 died... 10:51:07.186534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30865): Terminated: ok {rc=0} 10:51:07.271511 bus /sierra_3: Setting Powered False 10:51:08.370232 bus /sierra_3: Setting Powered False 10:51:09.484331 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 10:51:10.570992 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:10.582417 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:10.623749 tst emergency_preemptive_call.py: using LAC 27882 10:51:10.740871 tst emergency_preemptive_call.py: using RAC 87 10:51:10.856144 tst emergency_preemptive_call.py: using CellId 27882 10:51:10.972772 tst emergency_preemptive_call.py: using BVCI 27883 10:51:11.078527 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:11.089332 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:11.099958 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:11.110598 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:11.121215 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 10:51:11.131805 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:11.243643 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:11.359887 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:11.473943 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:11.589237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:12.080150 run create_hlr_db(pid=30868): Launched 10:51:12.202274 bus /sierra_2: Setting Powered False 10:51:13.261587 run create_hlr_db(pid=30868): Terminated: ok {rc=0} 10:51:13.693090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30870): Launched 10:51:14.008001 run osmo-hlr_10.42.42.2(pid=30871): Launched 10:51:14.128549 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:14.670165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30873): Launched 10:51:14.985199 run osmo-stp_10.42.42.5(pid=30874): Launched 10:51:15.116107 tst emergency_preemptive_call.py: using MSISDN 7692 10:51:15.279339 run osmo-msc_10.42.42.6: Starting osmo-msc 10:51:15.861786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30876): Launched 10:51:16.229672 run osmo-msc_10.42.42.6(pid=30877): Launched 10:51:16.623381 run osmo-stp_10.42.42.5(pid=30874): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30874)] 10:51:16.846161 run osmo-stp_10.42.42.5(pid=30874): stdout: | (launched: 2022-12-10_10:51:14.928023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:16.973740 run osmo-stp_10.42.42.5(pid=30874): stderr: | 20221210105115122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105115122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105115122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105115123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105115123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105115123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105115123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:17.103925 run osmo-stp_10.42.42.5(pid=30874): stdout: | (launched: 2022-12-10_10:51:14.928023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:17.251481 run osmo-stp_10.42.42.5(pid=30874): stderr: | 20221210105115122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105115122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105115122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105115123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105115123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105115123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105115123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:17.397329 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30874): Process ended prematurely: osmo-stp_10.42.42.5(pid=30874) [trial-2373↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30874)] [trial-2373↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 10:51:17.406156 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 10:51:17.434230 run osmo-hlr_10.42.42.2(pid=30871): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30871)] 10:51:17.483370 run osmo-hlr_10.42.42.2(pid=30871): stdout: | (launched: 2022-12-10_10:51:13.950839) 10:51:17.533783 run osmo-hlr_10.42.42.2(pid=30871): stderr: | 20221210105114149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105114149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105114149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105114150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105114150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105114150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105114163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105114173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105114173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105114173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:17.603374 run osmo-msc_10.42.42.6(pid=30877): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30877)] 10:51:17.651573 run osmo-msc_10.42.42.6(pid=30877): stdout: | (launched: 2022-12-10_10:51:16.162537) 10:51:17.701714 run osmo-msc_10.42.42.6(pid=30877): stderr: | 20221210105116576 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105116577 DLGLOBAL DEBUG validating counter group 0x7fe90ad9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105116577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105116577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105116577 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105116577 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105116579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105116580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105116580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105116580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:51:17.752248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30870): Terminating (SIGTERM) 10:51:17.792557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30873): Terminating (SIGTERM) 10:51:17.833162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30876): Terminating (SIGTERM) 10:51:17.874244 --- ParallelTerminationStrategy: PID 30870 died... 10:51:17.893433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30870): Terminated: ok {rc=0} 10:51:17.938710 --- ParallelTerminationStrategy: PID 30873 died... 10:51:17.957453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30873): Terminated: ok {rc=0} 10:51:18.002420 --- ParallelTerminationStrategy: PID 30876 died... 10:51:18.021126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30876): Terminated: ok {rc=0} 10:51:18.107766 bus /sierra_9: Setting Powered False 10:51:19.206004 bus /sierra_9: Setting Powered False 10:51:20.321188 bus /sierra_8: Setting Powered False 10:51:21.419509 bus /sierra_8: Setting Powered False 10:51:22.531256 bus /sierra_3: Setting Powered False 10:51:23.628733 bus /sierra_3: Setting Powered False 10:51:24.746602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-1900 --------------------------------------------------------------------- 10:51:26.020883 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:51:26.026546 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 10:51:26.051916 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 10:51:26.091867 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 10:51:26.179963 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 10:51:26.204015 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 10:51:26.243219 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 10:51:26.837460 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 10:51:26.890009 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:26.901202 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:26.943194 tst cs_paging_gprs_active.py: using LAC 27883 10:51:27.069555 tst cs_paging_gprs_active.py: using RAC 88 10:51:27.196655 tst cs_paging_gprs_active.py: using CellId 27883 10:51:27.322935 tst cs_paging_gprs_active.py: using BVCI 27884 10:51:27.439312 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.450501 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.461421 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.472456 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.483661 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.494829 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.506118 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.517149 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:27.528322 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:27.648487 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:27.765507 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:51:27.967916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:28.269393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30882): Launched 10:51:28.532119 run iperf3-srv_10.42.42.10(pid=30883): Launched 10:51:28.645064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:51:28.846266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:29.148082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30884): Launched 10:51:29.410089 run iperf3-srv_10.42.42.10(pid=30885): Launched 10:51:29.522775 tst cs_paging_gprs_active.py:38: start network... 10:51:29.723394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:30.187594 run create_hlr_db(pid=30886): Launched 10:51:30.311757 bus /sierra_2: Setting Powered False 10:51:31.397729 run create_hlr_db(pid=30886): Terminated: ok {rc=0} 10:51:31.875807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30888): Launched 10:51:32.254313 run osmo-hlr_10.42.42.2(pid=30889): Launched 10:51:32.378621 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:32.934032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30891): Launched 10:51:33.255465 run osmo-stp_10.42.42.5(pid=30892): Launched 10:51:33.379006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:33.944006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30894): Launched 10:51:34.067692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:34.338565 run patchelf(pid=30895): Launched 10:51:34.518926 run osmo-stp_10.42.42.5(pid=30892): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30892)] 10:51:34.655731 run osmo-stp_10.42.42.5(pid=30892): stdout: | (launched: 2022-12-10_10:51:33.197792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:34.793856 run osmo-stp_10.42.42.5(pid=30892): stderr: | 20221210105133386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105133386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105133387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105133387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105133388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105133388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105133388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:34.932016 run osmo-stp_10.42.42.5(pid=30892): stdout: | (launched: 2022-12-10_10:51:33.197792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:35.064623 run osmo-stp_10.42.42.5(pid=30892): stderr: | 20221210105133386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105133386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105133387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105133387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105133388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105133388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105133388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:35.221664 run patchelf(pid=30895): Terminating (SIGINT) 10:51:35.402882 run patchelf(pid=30895): Terminated: ok {rc=0} 10:51:35.533374 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30892): Process ended prematurely: osmo-stp_10.42.42.5(pid=30892) [trial-2373↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30892)] [trial-2373↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 10:51:35.543464 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 10:51:35.572714 run osmo-hlr_10.42.42.2(pid=30889): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30889)] 10:51:35.622921 run osmo-hlr_10.42.42.2(pid=30889): stdout: | (launched: 2022-12-10_10:51:32.198270) 10:51:35.675220 run osmo-hlr_10.42.42.2(pid=30889): stderr: | 20221210105132391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105132391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105132391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105132391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105132391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105132392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105132404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105132412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105132412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105132413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:35.727636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30882): Terminating (SIGTERM) 10:51:35.769745 run iperf3-srv_10.42.42.10(pid=30883): Terminating (SIGTERM) 10:51:35.811740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30884): Terminating (SIGTERM) 10:51:35.853788 run iperf3-srv_10.42.42.10(pid=30885): Terminating (SIGTERM) 10:51:35.895562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30888): Terminating (SIGTERM) 10:51:35.937569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30891): Terminating (SIGTERM) 10:51:35.979787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30894): Terminating (SIGTERM) 10:51:36.022174 --- ParallelTerminationStrategy: PID 30882 died... 10:51:36.042141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30882): Terminated: ok {rc=0} 10:51:36.088896 --- ParallelTerminationStrategy: PID 30883 died... 10:51:36.108383 run iperf3-srv_10.42.42.10(pid=30883): Terminated {rc=256} 10:51:36.154737 --- ParallelTerminationStrategy: PID 30884 died... 10:51:36.174250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30884): Terminated: ok {rc=0} 10:51:36.220633 --- ParallelTerminationStrategy: PID 30885 died... 10:51:36.240081 run iperf3-srv_10.42.42.10(pid=30885): Terminated {rc=256} 10:51:36.286797 --- ParallelTerminationStrategy: PID 30888 died... 10:51:36.306344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30888): Terminated: ok {rc=0} 10:51:36.352582 --- ParallelTerminationStrategy: PID 30891 died... 10:51:36.372082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30891): Terminated: ok {rc=0} 10:51:36.418316 --- ParallelTerminationStrategy: PID 30894 died... 10:51:36.437833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30894): Terminated: ok {rc=0} 10:51:36.525998 bus /gobi_0: Setting Powered False 10:51:37.624390 bus /gobi_0: Setting Powered False 10:51:38.742495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 10:51:39.888810 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:39.899970 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:39.938539 tst iperf3.py: using LAC 27884 10:51:40.058003 tst iperf3.py: using RAC 89 10:51:40.175293 tst iperf3.py: using CellId 27884 10:51:40.294551 tst iperf3.py: using BVCI 27885 10:51:40.405607 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.416175 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.426732 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.437278 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.447535 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.457945 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.468590 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.478992 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:40.489633 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:40.610034 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:51:40.810505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:41.109986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30896): Launched 10:51:41.370550 run iperf3-srv_10.42.42.10(pid=30897): Launched 10:51:41.482389 tst iperf3.py:8: start network... 10:51:41.682868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:42.146689 run create_hlr_db(pid=30898): Launched 10:51:42.269107 bus /gobi_6: Setting Powered False 10:51:43.329898 run create_hlr_db(pid=30898): Terminated: ok {rc=0} 10:51:43.766365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Launched 10:51:44.087269 run osmo-hlr_10.42.42.2(pid=30901): Launched 10:51:44.209774 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:44.761191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Launched 10:51:45.079615 run osmo-stp_10.42.42.5(pid=30904): Launched 10:51:45.201174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:45.753878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30906): Launched 10:51:45.895288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:46.172204 run patchelf(pid=30907): Launched 10:51:46.348545 run osmo-stp_10.42.42.5(pid=30904): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] 10:51:46.481203 run osmo-stp_10.42.42.5(pid=30904): stdout: | (launched: 2022-12-10_10:51:45.022299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:46.614781 run osmo-stp_10.42.42.5(pid=30904): stderr: | 20221210105145214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105145215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105145215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105145215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105145218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105145218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105145218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:46.749118 run osmo-stp_10.42.42.5(pid=30904): stdout: | (launched: 2022-12-10_10:51:45.022299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:46.877160 run osmo-stp_10.42.42.5(pid=30904): stderr: | 20221210105145214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105145215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105145215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105145215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105145218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105145218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105145218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:47.054537 run patchelf(pid=30907): Terminating (SIGINT) 10:51:47.231358 run patchelf(pid=30907): Terminated: ok {rc=0} 10:51:47.353862 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30904): Process ended prematurely: osmo-stp_10.42.42.5(pid=30904) [trial-2373↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] [trial-2373↪gprs:nanobts+band-1900↪iperf3.py:8] 10:51:47.363306 tst iperf3.py:8: Test FAILED (7.5 sec) 10:51:47.390687 run osmo-hlr_10.42.42.2(pid=30901): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30901)] 10:51:47.438386 run osmo-hlr_10.42.42.2(pid=30901): stdout: | (launched: 2022-12-10_10:51:44.029490) 10:51:47.487855 run osmo-hlr_10.42.42.2(pid=30901): stderr: | 20221210105144226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105144226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105144226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105144226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105144226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105144226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105144239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105144249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105144249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105144249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:51:47.537638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30896): Terminating (SIGTERM) 10:51:47.577540 run iperf3-srv_10.42.42.10(pid=30897): Terminating (SIGTERM) 10:51:47.617199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Terminating (SIGTERM) 10:51:47.657582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Terminating (SIGTERM) 10:51:47.697349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30906): Terminating (SIGTERM) 10:51:47.737499 --- ParallelTerminationStrategy: PID 30896 died... 10:51:47.756618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30896): Terminated: ok {rc=0} 10:51:47.801043 --- ParallelTerminationStrategy: PID 30897 died... 10:51:47.819701 run iperf3-srv_10.42.42.10(pid=30897): Terminated {rc=256} 10:51:47.863580 --- ParallelTerminationStrategy: PID 30900 died... 10:51:47.882209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Terminated: ok {rc=0} 10:51:47.925961 --- ParallelTerminationStrategy: PID 30903 died... 10:51:47.944602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Terminated: ok {rc=0} 10:51:47.988812 --- ParallelTerminationStrategy: PID 30906 died... 10:51:48.007845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30906): Terminated: ok {rc=0} 10:51:48.091615 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 10:51:49.243717 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.255232 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:51:49.293734 tst iperf3m4.py: using LAC 27885 10:51:49.421978 tst iperf3m4.py: using RAC 90 10:51:49.547080 tst iperf3m4.py: using CellId 27885 10:51:49.672246 tst iperf3m4.py: using BVCI 27886 10:51:49.790112 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.801279 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.812166 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.823330 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.834546 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.845672 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.856852 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.867812 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:51:49.879168 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:49.999124 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:50.120075 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:50.234477 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:51:50.352897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:51:50.570005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:50.892005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30908): Launched 10:51:51.170935 run iperf3-srv_10.42.42.10(pid=30909): Launched 10:51:51.291821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:51:51.507441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:51.828929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30910): Launched 10:51:52.109281 run iperf3-srv_10.42.42.10(pid=30911): Launched 10:51:52.229623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:51:52.445450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:52.767257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30912): Launched 10:51:53.046608 run iperf3-srv_10.42.42.10(pid=30913): Launched 10:51:53.166843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:51:53.382811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:51:53.704330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30914): Launched 10:51:53.983431 run iperf3-srv_10.42.42.10(pid=30915): Launched 10:51:54.103805 tst iperf3m4.py:8: start network... 10:51:54.319208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:51:54.814263 run create_hlr_db(pid=30916): Launched 10:51:54.936279 bus /gobi_6: Setting Powered False 10:51:56.000771 run create_hlr_db(pid=30916): Terminated: ok {rc=0} 10:51:56.446737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30918): Launched 10:51:56.767416 run osmo-hlr_10.42.42.2(pid=30919): Launched 10:51:56.890803 run osmo-stp_10.42.42.5: Starting osmo-stp 10:51:57.442700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30921): Launched 10:51:57.762589 run osmo-stp_10.42.42.5(pid=30922): Launched 10:51:57.885022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:51:58.436447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30924): Launched 10:51:58.560174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:51:58.829965 run patchelf(pid=30925): Launched 10:51:59.011030 run osmo-stp_10.42.42.5(pid=30922): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30922)] 10:51:59.147138 run osmo-stp_10.42.42.5(pid=30922): stdout: | (launched: 2022-12-10_10:51:57.704823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:59.285515 run osmo-stp_10.42.42.5(pid=30922): stderr: | 20221210105157895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105157895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105157895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105157896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105157898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105157898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105157898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:59.423550 run osmo-stp_10.42.42.5(pid=30922): stdout: | (launched: 2022-12-10_10:51:57.704823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:51:59.555244 run osmo-stp_10.42.42.5(pid=30922): stderr: | 20221210105157895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105157895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105157895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105157896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105157898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105157898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105157898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:51:59.711695 run patchelf(pid=30925): Terminating (SIGINT) 10:51:59.892028 run patchelf(pid=30925): Terminated: ok {rc=0} 10:52:00.022817 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30922): Process ended prematurely: osmo-stp_10.42.42.5(pid=30922) [trial-2373↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30922)] [trial-2373↪gprs:nanobts+band-1900↪iperf3m4.py:8] 10:52:00.032875 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:52:00.062081 run osmo-hlr_10.42.42.2(pid=30919): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30919)] 10:52:00.112191 run osmo-hlr_10.42.42.2(pid=30919): stdout: | (launched: 2022-12-10_10:51:56.709428) 10:52:00.163856 run osmo-hlr_10.42.42.2(pid=30919): stderr: | 20221210105156909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105156909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105156909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105156909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105156909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105156909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105156921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105156929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105156930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105156930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:00.216030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30908): Terminating (SIGTERM) 10:52:00.257844 run iperf3-srv_10.42.42.10(pid=30909): Terminating (SIGTERM) 10:52:00.299541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30910): Terminating (SIGTERM) 10:52:00.341432 run iperf3-srv_10.42.42.10(pid=30911): Terminating (SIGTERM) 10:52:00.383209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30912): Terminating (SIGTERM) 10:52:00.425224 run iperf3-srv_10.42.42.10(pid=30913): Terminating (SIGTERM) 10:52:00.467108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30914): Terminating (SIGTERM) 10:52:00.509097 run iperf3-srv_10.42.42.10(pid=30915): Terminating (SIGTERM) 10:52:00.550892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30918): Terminating (SIGTERM) 10:52:00.592604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30921): Terminating (SIGTERM) 10:52:00.634209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30924): Terminating (SIGTERM) 10:52:00.676231 --- ParallelTerminationStrategy: PID 30908 died... 10:52:00.696296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30908): Terminated: ok {rc=0} 10:52:00.743109 --- ParallelTerminationStrategy: PID 30909 died... 10:52:00.762732 run iperf3-srv_10.42.42.10(pid=30909): Terminated {rc=256} 10:52:00.809317 --- ParallelTerminationStrategy: PID 30910 died... 10:52:00.830140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30910): Terminated: ok {rc=0} 10:52:00.891240 --- ParallelTerminationStrategy: PID 30911 died... 10:52:00.911878 run iperf3-srv_10.42.42.10(pid=30911): Terminated {rc=256} 10:52:00.965979 --- ParallelTerminationStrategy: PID 30912 died... 10:52:00.986238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30912): Terminated: ok {rc=0} 10:52:01.037798 --- ParallelTerminationStrategy: PID 30913 died... 10:52:01.061788 run iperf3-srv_10.42.42.10(pid=30913): Terminated {rc=256} 10:52:01.124361 --- ParallelTerminationStrategy: PID 30914 died... 10:52:01.150281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30914): Terminated: ok {rc=0} 10:52:01.212217 --- ParallelTerminationStrategy: PID 30915 died... 10:52:01.235574 run iperf3-srv_10.42.42.10(pid=30915): Terminated {rc=256} 10:52:01.297421 --- ParallelTerminationStrategy: PID 30918 died... 10:52:01.324036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30918): Terminated: ok {rc=0} 10:52:01.384256 --- ParallelTerminationStrategy: PID 30921 died... 10:52:01.410464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30921): Terminated: ok {rc=0} 10:52:01.469954 --- ParallelTerminationStrategy: PID 30924 died... 10:52:01.495884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30924): Terminated: ok {rc=0} 10:52:01.608207 bus /gobi_4: Setting Powered False 10:52:02.723335 bus /gobi_4: Setting Powered False 10:52:03.839986 bus /gobi_1: Setting Powered False 10:52:04.938256 bus /gobi_1: Setting Powered False 10:52:06.054058 bus /gobi_0: Setting Powered False 10:52:07.152250 bus /gobi_0: Setting Powered False 10:52:08.268653 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 10:52:09.371038 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.382847 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:52:09.425153 tst ping.py: using LAC 27886 10:52:09.545194 tst ping.py: using RAC 91 10:52:09.660271 tst ping.py: using CellId 27886 10:52:09.774245 tst ping.py: using BVCI 27887 10:52:09.880467 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.891252 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.901936 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.912505 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.922998 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.933569 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.944137 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:09.954694 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:52:10.072476 tst ping.py:19: start network... 10:52:10.269704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:10.723701 run create_hlr_db(pid=30926): Launched 10:52:10.843819 bus /gobi_6: Setting Powered False 10:52:11.903712 run create_hlr_db(pid=30926): Terminated: ok {rc=0} 10:52:12.315861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Launched 10:52:12.610690 run osmo-hlr_10.42.42.2(pid=30929): Launched 10:52:12.722677 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:13.232227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Launched 10:52:13.529165 run osmo-stp_10.42.42.5(pid=30932): Launched 10:52:13.642027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:14.165436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30934): Launched 10:52:14.278494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:14.527174 run patchelf(pid=30935): Launched 10:52:14.690905 run osmo-stp_10.42.42.5(pid=30932): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] 10:52:14.816578 run osmo-stp_10.42.42.5(pid=30932): stdout: | (launched: 2022-12-10_10:52:13.474911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:14.943859 run osmo-stp_10.42.42.5(pid=30932): stderr: | 20221210105213645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105213646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105213646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105213646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105213647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105213647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105213647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:15.071451 run osmo-stp_10.42.42.5(pid=30932): stdout: | (launched: 2022-12-10_10:52:13.474911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:15.192255 run osmo-stp_10.42.42.5(pid=30932): stderr: | 20221210105213645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105213646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105213646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105213646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105213647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105213647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105213647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:15.336099 run patchelf(pid=30935): Terminating (SIGINT) 10:52:15.504129 run patchelf(pid=30935): Terminated: ok {rc=0} 10:52:15.623564 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30932): Process ended prematurely: osmo-stp_10.42.42.5(pid=30932) [trial-2373↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] [trial-2373↪gprs:nanobts+band-1900↪ping.py:22] 10:52:15.632445 tst ping.py:22: Test FAILED (6.3 sec) 10:52:15.659389 run osmo-hlr_10.42.42.2(pid=30929): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30929)] 10:52:15.706907 run osmo-hlr_10.42.42.2(pid=30929): stdout: | (launched: 2022-12-10_10:52:12.557068) 10:52:15.756029 run osmo-hlr_10.42.42.2(pid=30929): stderr: | 20221210105212731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105212731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105212731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105212731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105212731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105212731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105212743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105212752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105212752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105212752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:15.805575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Terminating (SIGTERM) 10:52:15.863464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Terminating (SIGTERM) 10:52:15.926904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30934): Terminating (SIGTERM) 10:52:15.973875 --- ParallelTerminationStrategy: PID 30928 died... 10:52:15.995008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Terminated: ok {rc=0} 10:52:16.048517 --- ParallelTerminationStrategy: PID 30931 died... 10:52:16.068104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Terminated: ok {rc=0} 10:52:16.113162 --- ParallelTerminationStrategy: PID 30934 died... 10:52:16.132376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30934): Terminated: ok {rc=0} 10:52:16.217476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 10:52:17.303339 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.314708 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 10:52:17.354151 tst ping_idle_ping.py: using LAC 27887 10:52:17.472510 tst ping_idle_ping.py: using RAC 92 10:52:17.587943 tst ping_idle_ping.py: using CellId 27887 10:52:17.703905 tst ping_idle_ping.py: using BVCI 27888 10:52:17.810970 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.821707 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.832199 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.842760 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.853172 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.863559 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.874179 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 10:52:17.884664 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 10:52:18.000911 tst ping_idle_ping.py:24: start network... 10:52:18.214744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:18.704763 run create_hlr_db(pid=30936): Launched 10:52:18.826105 bus /gobi_6: Setting Powered False 10:52:19.889308 run create_hlr_db(pid=30936): Terminated: ok {rc=0} 10:52:20.313302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30938): Launched 10:52:20.609185 run osmo-hlr_10.42.42.2(pid=30939): Launched 10:52:20.724325 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:21.246362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30941): Launched 10:52:21.543090 run osmo-stp_10.42.42.5(pid=30942): Launched 10:52:21.656562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:22.168742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30944): Launched 10:52:22.282002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:22.530645 run patchelf(pid=30945): Launched 10:52:22.695030 run osmo-stp_10.42.42.5(pid=30942): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30942)] 10:52:22.820071 run osmo-stp_10.42.42.5(pid=30942): stdout: | (launched: 2022-12-10_10:52:21.489257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:22.947345 run osmo-stp_10.42.42.5(pid=30942): stderr: | 20221210105221657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105221658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105221658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105221658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105221661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105221661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105221661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:23.074272 run osmo-stp_10.42.42.5(pid=30942): stdout: | (launched: 2022-12-10_10:52:21.489257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:23.195463 run osmo-stp_10.42.42.5(pid=30942): stderr: | 20221210105221657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105221658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105221658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105221658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105221661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105221661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105221661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:23.338867 run patchelf(pid=30945): Terminating (SIGINT) 10:52:23.506021 run patchelf(pid=30945): Terminated: ok {rc=0} 10:52:23.625666 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30942): Process ended prematurely: osmo-stp_10.42.42.5(pid=30942) [trial-2373↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30942)] [trial-2373↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 10:52:23.634414 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 10:52:23.660828 run osmo-hlr_10.42.42.2(pid=30939): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30939)] 10:52:23.708049 run osmo-hlr_10.42.42.2(pid=30939): stdout: | (launched: 2022-12-10_10:52:20.555134) 10:52:23.756880 run osmo-hlr_10.42.42.2(pid=30939): stderr: | 20221210105220731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105220731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105220731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105220731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105220731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105220731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105220743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105220752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105220752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105220752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:23.805725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30938): Terminating (SIGTERM) 10:52:23.844843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30941): Terminating (SIGTERM) 10:52:23.883885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30944): Terminating (SIGTERM) 10:52:23.923404 --- ParallelTerminationStrategy: PID 30938 died... 10:52:23.942419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30938): Terminated: ok {rc=0} 10:52:23.986022 --- ParallelTerminationStrategy: PID 30941 died... 10:52:24.004475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30941): Terminated: ok {rc=0} 10:52:24.048073 --- ParallelTerminationStrategy: PID 30944 died... 10:52:24.066601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30944): Terminated: ok {rc=0} 10:52:24.149101 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 10:52:25.448585 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:52:25.455650 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:52:25.481244 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:52:25.521662 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:52:25.610343 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:52:25.634403 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:52:25.674873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:52:26.274836 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:52:26.329432 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.340649 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:52:26.380476 tst cs_paging_gprs_active.py: using LAC 27888 10:52:26.505383 tst cs_paging_gprs_active.py: using RAC 93 10:52:26.629166 tst cs_paging_gprs_active.py: using CellId 27888 10:52:26.753786 tst cs_paging_gprs_active.py: using BVCI 27889 10:52:26.870160 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.881592 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.892691 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.904193 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.915449 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.926851 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.938543 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.949865 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:26.961397 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:52:27.079237 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:52:27.195194 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:52:27.396662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:27.698014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30950): Launched 10:52:27.958184 run iperf3-srv_10.42.42.10(pid=30951): Launched 10:52:28.070161 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:52:28.270152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:28.569755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30952): Launched 10:52:28.830284 run iperf3-srv_10.42.42.10(pid=30953): Launched 10:52:28.942191 tst cs_paging_gprs_active.py:38: start network... 10:52:29.142179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:29.605656 run create_hlr_db(pid=30954): Launched 10:52:29.728239 bus /gobi_6: Setting Powered False 10:52:30.789326 run create_hlr_db(pid=30954): Terminated: ok {rc=0} 10:52:31.263953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30956): Launched 10:52:31.614405 run osmo-hlr_10.42.42.2(pid=30957): Launched 10:52:31.844081 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:32.474518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30959): Launched 10:52:32.795909 run osmo-stp_10.42.42.5(pid=30960): Launched 10:52:32.918772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:33.472359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30962): Launched 10:52:33.596210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:33.867485 run patchelf(pid=30963): Launched 10:52:34.047692 run osmo-stp_10.42.42.5(pid=30960): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30960)] 10:52:34.184345 run osmo-stp_10.42.42.5(pid=30960): stdout: | (launched: 2022-12-10_10:52:32.738108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:34.322833 run osmo-stp_10.42.42.5(pid=30960): stderr: | 20221210105232932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105232932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105232932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105232933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105232933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105232933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105232933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:34.461162 run osmo-stp_10.42.42.5(pid=30960): stdout: | (launched: 2022-12-10_10:52:32.738108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:34.593170 run osmo-stp_10.42.42.5(pid=30960): stderr: | 20221210105232932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105232932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105232932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105232933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105232933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105232933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105232933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:34.749807 run patchelf(pid=30963): Terminating (SIGINT) 10:52:34.931001 run patchelf(pid=30963): Terminated: ok {rc=0} 10:52:35.062237 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30960): Process ended prematurely: osmo-stp_10.42.42.5(pid=30960) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30960)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:52:35.072421 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 10:52:35.101745 run osmo-hlr_10.42.42.2(pid=30957): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30957)] 10:52:35.152198 run osmo-hlr_10.42.42.2(pid=30957): stdout: | (launched: 2022-12-10_10:52:31.545629) 10:52:35.203974 run osmo-hlr_10.42.42.2(pid=30957): stderr: | 20221210105231856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105231856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105231856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105231856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105231856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105231856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105231888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105231907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105231907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105231907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:35.256275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30950): Terminating (SIGTERM) 10:52:35.298455 run iperf3-srv_10.42.42.10(pid=30951): Terminating (SIGTERM) 10:52:35.340431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30952): Terminating (SIGTERM) 10:52:35.382441 run iperf3-srv_10.42.42.10(pid=30953): Terminating (SIGTERM) 10:52:35.424176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30956): Terminating (SIGTERM) 10:52:35.466595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30959): Terminating (SIGTERM) 10:52:35.508271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30962): Terminating (SIGTERM) 10:52:35.550573 --- ParallelTerminationStrategy: PID 30950 died... 10:52:35.570658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30950): Terminated: ok {rc=0} 10:52:35.617365 --- ParallelTerminationStrategy: PID 30951 died... 10:52:35.636759 run iperf3-srv_10.42.42.10(pid=30951): Terminated {rc=256} 10:52:35.682771 --- ParallelTerminationStrategy: PID 30952 died... 10:52:35.702152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30952): Terminated: ok {rc=0} 10:52:35.748171 --- ParallelTerminationStrategy: PID 30953 died... 10:52:35.767495 run iperf3-srv_10.42.42.10(pid=30953): Terminated {rc=256} 10:52:35.813553 --- ParallelTerminationStrategy: PID 30956 died... 10:52:35.832842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30956): Terminated: ok {rc=0} 10:52:35.878883 --- ParallelTerminationStrategy: PID 30959 died... 10:52:35.898199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30959): Terminated: ok {rc=0} 10:52:35.944534 --- ParallelTerminationStrategy: PID 30962 died... 10:52:35.964414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30962): Terminated: ok {rc=0} 10:52:36.054963 bus /gobi_0: Setting Powered False 10:52:37.153690 bus /gobi_0: Setting Powered False 10:52:38.270143 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:52:39.415271 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:39.426857 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:52:39.469790 tst iperf3.py: using LAC 27889 10:52:39.596897 tst iperf3.py: using RAC 94 10:52:39.719519 tst iperf3.py: using CellId 27889 10:52:39.839862 tst iperf3.py: using BVCI 27890 10:52:39.949818 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:39.960676 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:39.971592 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:39.982406 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:39.993072 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:40.003714 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:40.014626 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:40.025337 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:40.036106 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:52:40.148318 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:52:40.349119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:40.649683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30965): Launched 10:52:40.912058 run iperf3-srv_10.42.42.10(pid=30966): Launched 10:52:41.025179 tst iperf3.py:8: start network... 10:52:41.225934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:41.691207 run create_hlr_db(pid=30967): Launched 10:52:41.813832 bus /gobi_6: Setting Powered False 10:52:42.874028 run create_hlr_db(pid=30967): Terminated: ok {rc=0} 10:52:43.291694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Launched 10:52:43.590592 run osmo-hlr_10.42.42.2(pid=30970): Launched 10:52:43.705705 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:44.223542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Launched 10:52:44.523680 run osmo-stp_10.42.42.5(pid=30973): Launched 10:52:44.638667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:45.158427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30975): Launched 10:52:45.274453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:45.526915 run patchelf(pid=30976): Launched 10:52:45.695215 run osmo-stp_10.42.42.5(pid=30973): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] 10:52:45.822653 run osmo-stp_10.42.42.5(pid=30973): stdout: | (launched: 2022-12-10_10:52:44.469105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:45.991816 run osmo-stp_10.42.42.5(pid=30973): stderr: | 20221210105244639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105244640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105244640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105244640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105244641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105244641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105244641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:46.149973 run osmo-stp_10.42.42.5(pid=30973): stdout: | (launched: 2022-12-10_10:52:44.469105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:46.286223 run osmo-stp_10.42.42.5(pid=30973): stderr: | 20221210105244639 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105244640 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105244640 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105244640 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105244641 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105244641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105244641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:46.447385 run patchelf(pid=30976): Terminating (SIGINT) 10:52:46.634257 run patchelf(pid=30976): Terminated: ok {rc=0} 10:52:46.769369 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30973): Process ended prematurely: osmo-stp_10.42.42.5(pid=30973) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 10:52:46.780918 tst iperf3.py:8: Test FAILED (7.4 sec) 10:52:46.814788 run osmo-hlr_10.42.42.2(pid=30970): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30970)] 10:52:46.868203 run osmo-hlr_10.42.42.2(pid=30970): stdout: | (launched: 2022-12-10_10:52:43.536264) 10:52:46.923011 run osmo-hlr_10.42.42.2(pid=30970): stderr: | 20221210105243713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105243713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105243713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105243713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105243713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105243713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105243725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105243735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105243735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105243735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:46.978650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30965): Terminating (SIGTERM) 10:52:47.027004 run iperf3-srv_10.42.42.10(pid=30966): Terminating (SIGTERM) 10:52:47.075119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Terminating (SIGTERM) 10:52:47.120539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Terminating (SIGTERM) 10:52:47.166788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30975): Terminating (SIGTERM) 10:52:47.211863 --- ParallelTerminationStrategy: PID 30965 died... 10:52:47.232065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30965): Terminated: ok {rc=0} 10:52:47.280111 --- ParallelTerminationStrategy: PID 30966 died... 10:52:47.299904 run iperf3-srv_10.42.42.10(pid=30966): Terminated {rc=256} 10:52:47.347512 --- ParallelTerminationStrategy: PID 30969 died... 10:52:47.367095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Terminated: ok {rc=0} 10:52:47.414877 --- ParallelTerminationStrategy: PID 30972 died... 10:52:47.434509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Terminated: ok {rc=0} 10:52:47.482325 --- ParallelTerminationStrategy: PID 30975 died... 10:52:47.501985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30975): Terminated: ok {rc=0} 10:52:47.591687 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:52:48.745546 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:48.757441 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:52:48.798198 tst iperf3m4.py: using LAC 27890 10:52:48.923139 tst iperf3m4.py: using RAC 95 10:52:49.050901 tst iperf3m4.py: using CellId 27890 10:52:49.179044 tst iperf3m4.py: using BVCI 27891 10:52:49.297495 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.309000 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.320161 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.332091 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.343964 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.355784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.367896 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.379678 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:52:49.391537 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:52:49.511536 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:52:49.631210 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:52:49.751000 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:52:49.871496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:52:50.090268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:50.413073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Launched 10:52:50.693782 run iperf3-srv_10.42.42.10(pid=30978): Launched 10:52:50.815141 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:52:51.032877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:51.356444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30979): Launched 10:52:51.636894 run iperf3-srv_10.42.42.10(pid=30980): Launched 10:52:51.758574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:52:51.976216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:52.299464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30981): Launched 10:52:52.580570 run iperf3-srv_10.42.42.10(pid=30982): Launched 10:52:52.702261 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:52:52.919824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:52:53.243142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30983): Launched 10:52:53.522425 run iperf3-srv_10.42.42.10(pid=30984): Launched 10:52:53.643228 tst iperf3m4.py:8: start network... 10:52:53.860093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:52:54.357966 run create_hlr_db(pid=30985): Launched 10:52:54.479680 bus /gobi_6: Setting Powered False 10:52:55.542743 run create_hlr_db(pid=30985): Terminated: ok {rc=0} 10:52:55.991537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30987): Launched 10:52:56.312934 run osmo-hlr_10.42.42.2(pid=30988): Launched 10:52:56.437123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:52:56.995742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30990): Launched 10:52:57.316621 run osmo-stp_10.42.42.5(pid=30991): Launched 10:52:57.440310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:52:57.994837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30993): Launched 10:52:58.114594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:52:58.366734 run patchelf(pid=30994): Launched 10:52:58.534184 run osmo-stp_10.42.42.5(pid=30991): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30991)] 10:52:58.661155 run osmo-stp_10.42.42.5(pid=30991): stdout: | (launched: 2022-12-10_10:52:57.258664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:58.789716 run osmo-stp_10.42.42.5(pid=30991): stderr: | 20221210105257450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105257450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105257450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105257451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105257451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105257451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105257451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:58.918240 run osmo-stp_10.42.42.5(pid=30991): stdout: | (launched: 2022-12-10_10:52:57.258664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:52:59.040656 run osmo-stp_10.42.42.5(pid=30991): stderr: | 20221210105257450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105257450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105257450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105257451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105257451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105257451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105257451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:52:59.185766 run patchelf(pid=30994): Terminating (SIGINT) 10:52:59.354558 run patchelf(pid=30994): Terminated: ok {rc=0} 10:52:59.476308 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30991): Process ended prematurely: osmo-stp_10.42.42.5(pid=30991) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30991)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 10:52:59.485662 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:52:59.512579 run osmo-hlr_10.42.42.2(pid=30988): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30988)] 10:52:59.559953 run osmo-hlr_10.42.42.2(pid=30988): stdout: | (launched: 2022-12-10_10:52:56.254972) 10:52:59.608646 run osmo-hlr_10.42.42.2(pid=30988): stderr: | 20221210105256455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105256455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105256455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105256455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105256455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105256455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105256471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105256480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105256480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105256480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:52:59.657714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Terminating (SIGTERM) 10:52:59.697043 run iperf3-srv_10.42.42.10(pid=30978): Terminating (SIGTERM) 10:52:59.737860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30979): Terminating (SIGTERM) 10:52:59.780724 run iperf3-srv_10.42.42.10(pid=30980): Terminating (SIGTERM) 10:52:59.822434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30981): Terminating (SIGTERM) 10:52:59.864221 run iperf3-srv_10.42.42.10(pid=30982): Terminating (SIGTERM) 10:52:59.905973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30983): Terminating (SIGTERM) 10:52:59.947677 run iperf3-srv_10.42.42.10(pid=30984): Terminating (SIGTERM) 10:52:59.989750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30987): Terminating (SIGTERM) 10:53:00.031518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30990): Terminating (SIGTERM) 10:53:00.073249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30993): Terminating (SIGTERM) 10:53:00.115210 --- ParallelTerminationStrategy: PID 30977 died... 10:53:00.135287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30977): Terminated: ok {rc=0} 10:53:00.181796 --- ParallelTerminationStrategy: PID 30978 died... 10:53:00.201271 run iperf3-srv_10.42.42.10(pid=30978): Terminated {rc=256} 10:53:00.247385 --- ParallelTerminationStrategy: PID 30979 died... 10:53:00.266901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30979): Terminated: ok {rc=0} 10:53:00.313217 --- ParallelTerminationStrategy: PID 30980 died... 10:53:00.332571 run iperf3-srv_10.42.42.10(pid=30980): Terminated {rc=256} 10:53:00.378713 --- ParallelTerminationStrategy: PID 30981 died... 10:53:00.398245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30981): Terminated: ok {rc=0} 10:53:00.444504 --- ParallelTerminationStrategy: PID 30982 died... 10:53:00.463946 run iperf3-srv_10.42.42.10(pid=30982): Terminated {rc=256} 10:53:00.510541 --- ParallelTerminationStrategy: PID 30983 died... 10:53:00.530100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30983): Terminated: ok {rc=0} 10:53:00.576248 --- ParallelTerminationStrategy: PID 30984 died... 10:53:00.595671 run iperf3-srv_10.42.42.10(pid=30984): Terminated {rc=256} 10:53:00.642162 --- ParallelTerminationStrategy: PID 30987 died... 10:53:00.661608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30987): Terminated: ok {rc=0} 10:53:00.707730 --- ParallelTerminationStrategy: PID 30990 died... 10:53:00.727271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30990): Terminated: ok {rc=0} 10:53:00.773526 --- ParallelTerminationStrategy: PID 30993 died... 10:53:00.793239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30993): Terminated: ok {rc=0} 10:53:00.887043 bus /gobi_4: Setting Powered False 10:53:02.001441 bus /gobi_4: Setting Powered False 10:53:03.127389 bus /gobi_1: Setting Powered False 10:53:04.226211 bus /gobi_1: Setting Powered False 10:53:05.342831 bus /gobi_0: Setting Powered False 10:53:06.440475 bus /gobi_0: Setting Powered False 10:53:07.556289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 10:53:08.658897 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:08.671079 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:53:08.713764 tst ping.py: using LAC 27891 10:53:08.839978 tst ping.py: using RAC 96 10:53:08.964941 tst ping.py: using CellId 27891 10:53:09.090405 tst ping.py: using BVCI 27892 10:53:09.205034 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:09.216470 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:09.227950 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:09.239510 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:09.250934 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:09.262521 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:09.274323 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:09.285828 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:53:09.403437 tst ping.py:19: start network... 10:53:09.615235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:10.101130 run create_hlr_db(pid=30995): Launched 10:53:10.221018 bus /gobi_6: Setting Powered False 10:53:11.283612 run create_hlr_db(pid=30995): Terminated: ok {rc=0} 10:53:11.705514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30997): Launched 10:53:12.001747 run osmo-hlr_10.42.42.2(pid=30998): Launched 10:53:12.114282 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:12.622298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31000): Launched 10:53:12.915990 run osmo-stp_10.42.42.5(pid=31001): Launched 10:53:13.027803 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:53:13.536758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31003): Launched 10:53:13.649936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:53:13.898108 run patchelf(pid=31004): Launched 10:53:14.062011 run osmo-stp_10.42.42.5(pid=31001): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31001)] 10:53:14.186158 run osmo-stp_10.42.42.5(pid=31001): stdout: | (launched: 2022-12-10_10:53:12.862259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:14.311700 run osmo-stp_10.42.42.5(pid=31001): stderr: | 20221210105313031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105313031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105313031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105313031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105313032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105313032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105313032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:14.437913 run osmo-stp_10.42.42.5(pid=31001): stdout: | (launched: 2022-12-10_10:53:12.862259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:14.558173 run osmo-stp_10.42.42.5(pid=31001): stderr: | 20221210105313031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105313031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105313031 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105313031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105313032 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105313032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105313032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:14.700615 run patchelf(pid=31004): Terminating (SIGINT) 10:53:14.865948 run patchelf(pid=31004): Terminated: ok {rc=0} 10:53:14.984916 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31001): Process ended prematurely: osmo-stp_10.42.42.5(pid=31001) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31001)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 10:53:14.993708 tst ping.py:22: Test FAILED (6.3 sec) 10:53:15.020239 run osmo-hlr_10.42.42.2(pid=30998): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30998)] 10:53:15.067179 run osmo-hlr_10.42.42.2(pid=30998): stdout: | (launched: 2022-12-10_10:53:11.947163) 10:53:15.115851 run osmo-hlr_10.42.42.2(pid=30998): stderr: | 20221210105312123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105312123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105312124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105312124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105312124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105312124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105312136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105312145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105312145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105312145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:15.165047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30997): Terminating (SIGTERM) 10:53:15.204265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31000): Terminating (SIGTERM) 10:53:15.243546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31003): Terminating (SIGTERM) 10:53:15.282973 --- ParallelTerminationStrategy: PID 30997 died... 10:53:15.301940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30997): Terminated: ok {rc=0} 10:53:15.345702 --- ParallelTerminationStrategy: PID 31000 died... 10:53:15.364193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31000): Terminated: ok {rc=0} 10:53:15.407521 --- ParallelTerminationStrategy: PID 31003 died... 10:53:15.426003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31003): Terminated: ok {rc=0} 10:53:15.511181 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:53:16.617383 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:16.635420 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:53:16.701035 tst ping_idle_ping.py: using LAC 27892 10:53:16.862213 tst ping_idle_ping.py: using RAC 97 10:53:16.993770 tst ping_idle_ping.py: using CellId 27892 10:53:17.155646 tst ping_idle_ping.py: using BVCI 27893 10:53:17.317386 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:17.332698 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:17.348713 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:17.363865 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:17.383058 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:17.400687 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:17.422405 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:53:17.437919 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:53:17.619349 tst ping_idle_ping.py:24: start network... 10:53:17.918511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:18.528285 run create_hlr_db(pid=31139): Launched 10:53:18.710511 bus /gobi_6: Setting Powered False 10:53:19.776090 run create_hlr_db(pid=31139): Terminated: ok {rc=0} 10:53:20.288821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31276): Launched 10:53:20.641733 run osmo-hlr_10.42.42.2(pid=31277): Launched 10:53:20.875574 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:21.560932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31281): Launched 10:53:21.877679 run osmo-stp_10.42.42.5(pid=31282): Launched 10:53:22.124899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:53:22.766017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31284): Launched 10:53:22.903064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:53:23.189754 run patchelf(pid=31285): Launched 10:53:23.376595 run osmo-stp_10.42.42.5(pid=31282): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31282)] 10:53:23.515555 run osmo-stp_10.42.42.5(pid=31282): stdout: | (launched: 2022-12-10_10:53:21.807498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:23.656294 run osmo-stp_10.42.42.5(pid=31282): stderr: | 20221210105322109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105322110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105322110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105322110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105322113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105322113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105322113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:23.798400 run osmo-stp_10.42.42.5(pid=31282): stdout: | (launched: 2022-12-10_10:53:21.807498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:23.932487 run osmo-stp_10.42.42.5(pid=31282): stderr: | 20221210105322109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105322110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105322110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105322110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105322113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105322113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105322113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:24.093419 run patchelf(pid=31285): Terminating (SIGINT) 10:53:24.276546 run patchelf(pid=31285): Terminated: ok {rc=0} 10:53:24.410603 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31282): Process ended prematurely: osmo-stp_10.42.42.5(pid=31282) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31282)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 10:53:24.421219 tst ping_idle_ping.py:27: Test FAILED (7.8 sec) 10:53:24.452880 run osmo-hlr_10.42.42.2(pid=31277): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31277)] 10:53:24.505501 run osmo-hlr_10.42.42.2(pid=31277): stdout: | (launched: 2022-12-10_10:53:20.566875) 10:53:24.560314 run osmo-hlr_10.42.42.2(pid=31277): stderr: | 20221210105320908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105320908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105320908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105320908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105320908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105320908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105320928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105320936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105320936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105320936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:24.617238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31276): Terminating (SIGTERM) 10:53:24.662930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31281): Terminating (SIGTERM) 10:53:24.709433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31284): Terminating (SIGTERM) 10:53:24.756402 --- ParallelTerminationStrategy: PID 31276 died... 10:53:24.778405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31276): Terminated: ok {rc=0} 10:53:24.831225 --- ParallelTerminationStrategy: PID 31281 died... 10:53:24.852306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31281): Terminated: ok {rc=0} 10:53:24.902051 --- ParallelTerminationStrategy: PID 31284 died... 10:53:24.922760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31284): Terminated: ok {rc=0} 10:53:25.016589 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:53:26.320329 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:53:26.328693 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:53:26.358049 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:53:26.400368 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:53:26.492575 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:53:26.518921 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:53:26.560530 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:53:27.157795 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:53:27.215116 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.227555 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:53:27.292188 tst cs_paging_gprs_active.py: using LAC 27893 10:53:27.424113 tst cs_paging_gprs_active.py: using RAC 98 10:53:27.553507 tst cs_paging_gprs_active.py: using CellId 27893 10:53:27.682211 tst cs_paging_gprs_active.py: using BVCI 27894 10:53:27.803513 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.816915 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.829386 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.843506 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.857010 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.870390 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.883347 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.897241 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:27.910929 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:53:28.039548 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:53:28.164175 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:53:28.386953 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:28.733794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31289): Launched 10:53:29.037176 run iperf3-srv_10.42.42.10(pid=31290): Launched 10:53:29.173702 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:53:29.397365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:29.737947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31291): Launched 10:53:30.049720 run iperf3-srv_10.42.42.10(pid=31292): Launched 10:53:30.183900 tst cs_paging_gprs_active.py:38: start network... 10:53:30.409772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:30.940919 run create_hlr_db(pid=31293): Launched 10:53:31.118756 bus /gobi_6: Setting Powered False 10:53:32.211342 run create_hlr_db(pid=31293): Terminated: ok {rc=0} 10:53:32.758577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31295): Launched 10:53:33.141786 run osmo-hlr_10.42.42.2(pid=31296): Launched 10:53:33.421495 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:34.030415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31298): Launched 10:53:34.375122 run osmo-stp_10.42.42.5(pid=31299): Launched 10:53:34.628834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:53:35.285036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31301): Launched 10:53:35.423405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:53:35.717128 run patchelf(pid=31302): Launched 10:53:35.909577 run osmo-stp_10.42.42.5(pid=31299): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31299)] 10:53:36.052754 run osmo-stp_10.42.42.5(pid=31299): stdout: | (launched: 2022-12-10_10:53:34.309278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:36.195753 run osmo-stp_10.42.42.5(pid=31299): stderr: | 20221210105334610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105334610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105334610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105334621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105334622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105334622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105334622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:36.339975 run osmo-stp_10.42.42.5(pid=31299): stdout: | (launched: 2022-12-10_10:53:34.309278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:36.477399 run osmo-stp_10.42.42.5(pid=31299): stderr: | 20221210105334610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105334610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105334610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105334621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105334622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105334622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105334622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:36.640754 run patchelf(pid=31302): Terminating (SIGINT) 10:53:36.831491 run patchelf(pid=31302): Terminated: ok {rc=0} 10:53:36.966150 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31299): Process ended prematurely: osmo-stp_10.42.42.5(pid=31299) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31299)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:53:36.977521 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 10:53:37.010145 run osmo-hlr_10.42.42.2(pid=31296): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31296)] 10:53:37.064345 run osmo-hlr_10.42.42.2(pid=31296): stdout: | (launched: 2022-12-10_10:53:33.063898) 10:53:37.118902 run osmo-hlr_10.42.42.2(pid=31296): stderr: | 20221210105333256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105333256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105333256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105333256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105333256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105333256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105333278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105333291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105333291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105333291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:37.174172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31289): Terminating (SIGTERM) 10:53:37.220353 run iperf3-srv_10.42.42.10(pid=31290): Terminating (SIGTERM) 10:53:37.268210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31291): Terminating (SIGTERM) 10:53:37.313500 run iperf3-srv_10.42.42.10(pid=31292): Terminating (SIGTERM) 10:53:37.360866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31295): Terminating (SIGTERM) 10:53:37.406092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31298): Terminating (SIGTERM) 10:53:37.453675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31301): Terminating (SIGTERM) 10:53:37.501530 --- ParallelTerminationStrategy: PID 31289 died... 10:53:37.523217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31289): Terminated: ok {rc=0} 10:53:37.575111 --- ParallelTerminationStrategy: PID 31290 died... 10:53:37.595958 run iperf3-srv_10.42.42.10(pid=31290): Terminated {rc=256} 10:53:37.646774 --- ParallelTerminationStrategy: PID 31291 died... 10:53:37.667855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31291): Terminated: ok {rc=0} 10:53:37.717874 --- ParallelTerminationStrategy: PID 31292 died... 10:53:37.738699 run iperf3-srv_10.42.42.10(pid=31292): Terminated {rc=256} 10:53:37.790216 --- ParallelTerminationStrategy: PID 31295 died... 10:53:37.811969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31295): Terminated: ok {rc=0} 10:53:37.862051 --- ParallelTerminationStrategy: PID 31298 died... 10:53:37.882992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31298): Terminated: ok {rc=0} 10:53:37.932740 --- ParallelTerminationStrategy: PID 31301 died... 10:53:37.953429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31301): Terminated: ok {rc=0} 10:53:38.047637 bus /gobi_0: Setting Powered False 10:53:39.151916 bus /gobi_0: Setting Powered False 10:53:40.271766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:53:41.417224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:41.428587 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:53:41.493954 tst iperf3.py: using LAC 27894 10:53:41.610347 tst iperf3.py: using RAC 99 10:53:41.727802 tst iperf3.py: using CellId 27894 10:53:41.843804 tst iperf3.py: using BVCI 27895 10:53:41.952029 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:41.963068 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:41.973954 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:41.984732 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:41.995535 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:42.006420 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:42.017353 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:42.028049 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:42.039082 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:53:42.153459 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:53:42.353426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:42.652785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31303): Launched 10:53:42.913757 run iperf3-srv_10.42.42.10(pid=31304): Launched 10:53:43.026218 tst iperf3.py:8: start network... 10:53:43.226548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:43.691619 run create_hlr_db(pid=31305): Launched 10:53:43.813219 bus /gobi_6: Setting Powered False 10:53:44.871410 run create_hlr_db(pid=31305): Terminated: ok {rc=0} 10:53:45.308175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31307): Launched 10:53:45.628278 run osmo-hlr_10.42.42.2(pid=31308): Launched 10:53:45.750929 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:46.342864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31310): Launched 10:53:46.692407 run osmo-stp_10.42.42.5(pid=31311): Launched 10:53:46.988587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:53:47.656646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31313): Launched 10:53:47.773416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:53:48.026224 run patchelf(pid=31314): Launched 10:53:48.195450 run osmo-stp_10.42.42.5(pid=31311): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31311)] 10:53:48.323949 run osmo-stp_10.42.42.5(pid=31311): stdout: | (launched: 2022-12-10_10:53:46.625169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:48.454250 run osmo-stp_10.42.42.5(pid=31311): stderr: | 20221210105346911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105346911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105346911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105346912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105346912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105346912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105346912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:48.584071 run osmo-stp_10.42.42.5(pid=31311): stdout: | (launched: 2022-12-10_10:53:46.625169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:53:48.707456 run osmo-stp_10.42.42.5(pid=31311): stderr: | 20221210105346911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105346911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105346911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105346912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105346912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105346912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105346912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:53:48.853586 run patchelf(pid=31314): Terminating (SIGINT) 10:53:49.022731 run patchelf(pid=31314): Terminated: ok {rc=0} 10:53:49.145246 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31311): Process ended prematurely: osmo-stp_10.42.42.5(pid=31311) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31311)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 10:53:49.154595 tst iperf3.py:8: Test FAILED (7.8 sec) 10:53:49.181551 run osmo-hlr_10.42.42.2(pid=31308): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31308)] 10:53:49.228781 run osmo-hlr_10.42.42.2(pid=31308): stdout: | (launched: 2022-12-10_10:53:45.570692) 10:53:49.277687 run osmo-hlr_10.42.42.2(pid=31308): stderr: | 20221210105345766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105345766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105345766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105345766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105345766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105345766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105345779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105345788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105345788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105345788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:53:49.327048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31303): Terminating (SIGTERM) 10:53:49.366784 run iperf3-srv_10.42.42.10(pid=31304): Terminating (SIGTERM) 10:53:49.406379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31307): Terminating (SIGTERM) 10:53:49.445888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31310): Terminating (SIGTERM) 10:53:49.485484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31313): Terminating (SIGTERM) 10:53:49.525360 --- ParallelTerminationStrategy: PID 31303 died... 10:53:49.544363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31303): Terminated: ok {rc=0} 10:53:49.588629 --- ParallelTerminationStrategy: PID 31304 died... 10:53:49.607244 run iperf3-srv_10.42.42.10(pid=31304): Terminated {rc=256} 10:53:49.651354 --- ParallelTerminationStrategy: PID 31307 died... 10:53:49.670126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31307): Terminated: ok {rc=0} 10:53:49.713728 --- ParallelTerminationStrategy: PID 31310 died... 10:53:49.732396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31310): Terminated: ok {rc=0} 10:53:49.776177 --- ParallelTerminationStrategy: PID 31313 died... 10:53:49.794949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31313): Terminated: ok {rc=0} 10:53:49.880321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:53:51.028095 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.039854 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:53:51.098649 tst iperf3m4.py: using LAC 27895 10:53:51.214633 tst iperf3m4.py: using RAC 100 10:53:51.332083 tst iperf3m4.py: using CellId 27895 10:53:51.448038 tst iperf3m4.py: using BVCI 27896 10:53:51.557101 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.568022 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.578856 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.589644 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.600207 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.611341 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.622377 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.633140 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:53:51.644028 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:53:51.757227 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:53:51.876529 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:53:51.995606 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:53:52.111169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:53:52.312394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:52.612902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31327): Launched 10:53:52.874339 run iperf3-srv_10.42.42.10(pid=31328): Launched 10:53:52.986843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:53:53.187786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:53.487788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31329): Launched 10:53:53.749491 run iperf3-srv_10.42.42.10(pid=31330): Launched 10:53:53.862584 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:53:54.063840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:54.366727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Launched 10:53:54.627535 run iperf3-srv_10.42.42.10(pid=31332): Launched 10:53:54.740106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:53:54.940841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:53:55.241614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Launched 10:53:55.502431 run iperf3-srv_10.42.42.10(pid=31334): Launched 10:53:55.614744 tst iperf3m4.py:8: start network... 10:53:55.815005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:53:56.280114 run create_hlr_db(pid=31335): Launched 10:53:56.403263 bus /gobi_6: Setting Powered False 10:53:57.463000 run create_hlr_db(pid=31335): Terminated: ok {rc=0} 10:53:57.901216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31337): Launched 10:53:58.223249 run osmo-hlr_10.42.42.2(pid=31338): Launched 10:53:58.346557 run osmo-stp_10.42.42.5: Starting osmo-stp 10:53:58.904322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31340): Launched 10:53:59.224069 run osmo-stp_10.42.42.5(pid=31341): Launched 10:53:59.346495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:53:59.897863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31343): Launched 10:54:00.022074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:00.294587 run patchelf(pid=31344): Launched 10:54:00.473845 run osmo-stp_10.42.42.5(pid=31341): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31341)] 10:54:00.609890 run osmo-stp_10.42.42.5(pid=31341): stdout: | (launched: 2022-12-10_10:53:59.166275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:00.747237 run osmo-stp_10.42.42.5(pid=31341): stderr: | 20221210105359357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105359357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105359357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105359358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105359358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105359358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105359358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:00.904544 run osmo-stp_10.42.42.5(pid=31341): stdout: | (launched: 2022-12-10_10:53:59.166275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:01.038614 run osmo-stp_10.42.42.5(pid=31341): stderr: | 20221210105359357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105359357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105359357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105359358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105359358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105359358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105359358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:01.197297 run patchelf(pid=31344): Terminating (SIGINT) 10:54:01.381073 run patchelf(pid=31344): Terminated: ok {rc=0} 10:54:01.514250 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31341): Process ended prematurely: osmo-stp_10.42.42.5(pid=31341) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31341)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 10:54:01.525119 tst iperf3m4.py:8: Test FAILED (10.5 sec) 10:54:01.555813 run osmo-hlr_10.42.42.2(pid=31338): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31338)] 10:54:01.607566 run osmo-hlr_10.42.42.2(pid=31338): stdout: | (launched: 2022-12-10_10:53:58.165362) 10:54:01.660708 run osmo-hlr_10.42.42.2(pid=31338): stderr: | 20221210105358364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105358364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105358364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105358364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105358364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105358364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105358377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105358385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105358385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105358385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:01.714224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31327): Terminating (SIGTERM) 10:54:01.758132 run iperf3-srv_10.42.42.10(pid=31328): Terminating (SIGTERM) 10:54:01.804246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31329): Terminating (SIGTERM) 10:54:01.848546 run iperf3-srv_10.42.42.10(pid=31330): Terminating (SIGTERM) 10:54:01.894711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Terminating (SIGTERM) 10:54:01.938744 run iperf3-srv_10.42.42.10(pid=31332): Terminating (SIGTERM) 10:54:01.984630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Terminating (SIGTERM) 10:54:02.028899 run iperf3-srv_10.42.42.10(pid=31334): Terminating (SIGTERM) 10:54:02.074925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31337): Terminating (SIGTERM) 10:54:02.118552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31340): Terminating (SIGTERM) 10:54:02.161718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31343): Terminating (SIGTERM) 10:54:02.206252 --- ParallelTerminationStrategy: PID 31327 died... 10:54:02.226716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31327): Terminated: ok {rc=0} 10:54:02.274745 --- ParallelTerminationStrategy: PID 31328 died... 10:54:02.294507 run iperf3-srv_10.42.42.10(pid=31328): Terminated {rc=256} 10:54:02.341264 --- ParallelTerminationStrategy: PID 31329 died... 10:54:02.361034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31329): Terminated: ok {rc=0} 10:54:02.407540 --- ParallelTerminationStrategy: PID 31330 died... 10:54:02.427071 run iperf3-srv_10.42.42.10(pid=31330): Terminated {rc=256} 10:54:02.473627 --- ParallelTerminationStrategy: PID 31331 died... 10:54:02.493306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Terminated: ok {rc=0} 10:54:02.539961 --- ParallelTerminationStrategy: PID 31332 died... 10:54:02.559514 run iperf3-srv_10.42.42.10(pid=31332): Terminated {rc=256} 10:54:02.605855 --- ParallelTerminationStrategy: PID 31333 died... 10:54:02.625597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Terminated: ok {rc=0} 10:54:02.671892 --- ParallelTerminationStrategy: PID 31334 died... 10:54:02.691330 run iperf3-srv_10.42.42.10(pid=31334): Terminated {rc=256} 10:54:02.737689 --- ParallelTerminationStrategy: PID 31337 died... 10:54:02.757254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31337): Terminated: ok {rc=0} 10:54:02.803585 --- ParallelTerminationStrategy: PID 31340 died... 10:54:02.823096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31340): Terminated: ok {rc=0} 10:54:02.869373 --- ParallelTerminationStrategy: PID 31343 died... 10:54:02.889057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31343): Terminated: ok {rc=0} 10:54:02.977342 bus /gobi_4: Setting Powered False 10:54:04.074652 bus /gobi_4: Setting Powered False 10:54:05.188742 bus /gobi_1: Setting Powered False 10:54:06.285752 bus /gobi_1: Setting Powered False 10:54:07.401174 bus /gobi_0: Setting Powered False 10:54:08.498311 bus /gobi_0: Setting Powered False 10:54:09.613496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 10:54:10.712284 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:10.723917 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:54:10.784363 tst ping.py: using LAC 27896 10:54:10.909342 tst ping.py: using RAC 101 10:54:11.032659 tst ping.py: using CellId 27896 10:54:11.156264 tst ping.py: using BVCI 27897 10:54:11.270815 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:11.282465 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:11.293761 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:11.305309 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:11.316731 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:11.328253 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:11.339879 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:11.351213 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:54:11.465565 tst ping.py:19: start network... 10:54:11.662832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:12.116881 run create_hlr_db(pid=31346): Launched 10:54:12.238141 bus /gobi_6: Setting Powered False 10:54:13.297963 run create_hlr_db(pid=31346): Terminated: ok {rc=0} 10:54:13.709700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31348): Launched 10:54:14.005585 run osmo-hlr_10.42.42.2(pid=31349): Launched 10:54:14.119165 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:14.634306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31351): Launched 10:54:14.928578 run osmo-stp_10.42.42.5(pid=31352): Launched 10:54:15.041674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:15.550297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31354): Launched 10:54:15.663031 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:15.956306 run patchelf(pid=31355): Launched 10:54:16.135538 run osmo-stp_10.42.42.5(pid=31352): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31352)] 10:54:16.263127 run osmo-stp_10.42.42.5(pid=31352): stdout: | (launched: 2022-12-10_10:54:14.874825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:16.392841 run osmo-stp_10.42.42.5(pid=31352): stderr: | 20221210105415044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105415044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105415044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105415045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105415047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105415047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105415047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:16.521678 run osmo-stp_10.42.42.5(pid=31352): stdout: | (launched: 2022-12-10_10:54:14.874825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:16.644404 run osmo-stp_10.42.42.5(pid=31352): stderr: | 20221210105415044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105415044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105415044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105415045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105415047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105415047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105415047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:16.790553 run patchelf(pid=31355): Terminating (SIGINT) 10:54:16.959657 run patchelf(pid=31355): Terminated: ok {rc=0} 10:54:17.082185 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31352): Process ended prematurely: osmo-stp_10.42.42.5(pid=31352) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31352)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 10:54:17.091663 tst ping.py:22: Test FAILED (6.4 sec) 10:54:17.119575 run osmo-hlr_10.42.42.2(pid=31349): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31349)] 10:54:17.168032 run osmo-hlr_10.42.42.2(pid=31349): stdout: | (launched: 2022-12-10_10:54:13.951436) 10:54:17.217357 run osmo-hlr_10.42.42.2(pid=31349): stderr: | 20221210105414128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105414128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105414128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105414128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105414128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105414128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105414140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105414149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105414149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105414149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:17.266917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31348): Terminating (SIGTERM) 10:54:17.306719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31351): Terminating (SIGTERM) 10:54:17.346411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31354): Terminating (SIGTERM) 10:54:17.386542 --- ParallelTerminationStrategy: PID 31348 died... 10:54:17.405067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31348): Terminated: ok {rc=0} 10:54:17.449190 --- ParallelTerminationStrategy: PID 31351 died... 10:54:17.467804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31351): Terminated: ok {rc=0} 10:54:17.511761 --- ParallelTerminationStrategy: PID 31354 died... 10:54:17.530242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31354): Terminated: ok {rc=0} 10:54:17.613131 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 10:54:18.698766 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:18.710904 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:54:18.776601 tst ping_idle_ping.py: using LAC 27897 10:54:18.900287 tst ping_idle_ping.py: using RAC 102 10:54:19.022204 tst ping_idle_ping.py: using CellId 27897 10:54:19.143804 tst ping_idle_ping.py: using BVCI 27898 10:54:19.258309 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:19.269853 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:19.281244 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:19.292705 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:19.304016 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:19.315598 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:19.327224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:54:19.338649 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:54:19.454097 tst ping_idle_ping.py:24: start network... 10:54:19.651742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:20.109480 run create_hlr_db(pid=31356): Launched 10:54:20.230726 bus /gobi_6: Setting Powered False 10:54:21.289792 run create_hlr_db(pid=31356): Terminated: ok {rc=0} 10:54:21.701535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31358): Launched 10:54:21.996161 run osmo-hlr_10.42.42.2(pid=31359): Launched 10:54:22.108525 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:22.615114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31361): Launched 10:54:22.909218 run osmo-stp_10.42.42.5(pid=31362): Launched 10:54:23.021863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:23.530256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31364): Launched 10:54:23.643071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:23.890365 run patchelf(pid=31365): Launched 10:54:24.054284 run osmo-stp_10.42.42.5(pid=31362): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31362)] 10:54:24.178833 run osmo-stp_10.42.42.5(pid=31362): stdout: | (launched: 2022-12-10_10:54:22.855281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:24.305898 run osmo-stp_10.42.42.5(pid=31362): stderr: | 20221210105423026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105423026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105423026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105423026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105423027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105423027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105423027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:24.433347 run osmo-stp_10.42.42.5(pid=31362): stdout: | (launched: 2022-12-10_10:54:22.855281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:24.554021 run osmo-stp_10.42.42.5(pid=31362): stderr: | 20221210105423026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105423026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105423026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105423026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105423027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105423027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105423027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:24.697289 run patchelf(pid=31365): Terminating (SIGINT) 10:54:24.863265 run patchelf(pid=31365): Terminated: ok {rc=0} 10:54:24.982885 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31362): Process ended prematurely: osmo-stp_10.42.42.5(pid=31362) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31362)] [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 10:54:24.991568 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 10:54:25.018125 run osmo-hlr_10.42.42.2(pid=31359): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31359)] 10:54:25.065245 run osmo-hlr_10.42.42.2(pid=31359): stdout: | (launched: 2022-12-10_10:54:21.942381) 10:54:25.113973 run osmo-hlr_10.42.42.2(pid=31359): stderr: | 20221210105422118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105422118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105422118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105422118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105422118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105422118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105422130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105422139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105422139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105422139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:25.162896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31358): Terminating (SIGTERM) 10:54:25.202368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31361): Terminating (SIGTERM) 10:54:25.241867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31364): Terminating (SIGTERM) 10:54:25.281514 --- ParallelTerminationStrategy: PID 31358 died... 10:54:25.300551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31358): Terminated: ok {rc=0} 10:54:25.344709 --- ParallelTerminationStrategy: PID 31361 died... 10:54:25.363085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31361): Terminated: ok {rc=0} 10:54:25.406907 --- ParallelTerminationStrategy: PID 31364 died... 10:54:25.425451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31364): Terminated: ok {rc=0} 10:54:25.508762 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 10:54:26.805920 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:26.814176 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:54:26.839503 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 10:54:26.875381 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:54:26.930186 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:54:26.953796 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 10:54:26.987901 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:54:27.549369 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 10:54:27.554262 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:27.566000 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:54:27.628598 tst switch_tch_pdch.py: using LAC 27898 10:54:27.744332 tst switch_tch_pdch.py: using RAC 103 10:54:27.857479 tst switch_tch_pdch.py: using CellId 27898 10:54:27.980175 tst switch_tch_pdch.py: using BVCI 27899 10:54:28.096161 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:28.108178 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:28.120047 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:28.132102 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:28.144564 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:28.156560 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:28.168752 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 10:54:28.180785 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:54:28.297354 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:54:28.411950 tst switch_tch_pdch.py:51: start network... 10:54:28.609679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:29.064167 run create_hlr_db(pid=31369): Launched 10:54:29.184834 bus /gobi_6: Setting Powered False 10:54:30.244928 run create_hlr_db(pid=31369): Terminated: ok {rc=0} 10:54:30.657140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Launched 10:54:30.961627 run osmo-hlr_10.42.42.2(pid=31372): Launched 10:54:31.074488 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:31.729915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Launched 10:54:32.049769 run osmo-stp_10.42.42.5(pid=31375): Launched 10:54:32.257194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:54:32.782445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31377): Launched 10:54:32.895901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:54:33.144940 run patchelf(pid=31378): Launched 10:54:33.309171 run osmo-stp_10.42.42.5(pid=31375): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] 10:54:33.434850 run osmo-stp_10.42.42.5(pid=31375): stdout: | (launched: 2022-12-10_10:54:31.982771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:33.561663 run osmo-stp_10.42.42.5(pid=31375): stderr: | 20221210105432339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105432340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105432340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105432340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105432349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105432349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105432349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:33.688711 run osmo-stp_10.42.42.5(pid=31375): stdout: | (launched: 2022-12-10_10:54:31.982771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:33.810197 run osmo-stp_10.42.42.5(pid=31375): stderr: | 20221210105432339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105432340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105432340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105432340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105432349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105432349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105432349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:33.953736 run patchelf(pid=31378): Terminating (SIGINT) 10:54:34.119301 run patchelf(pid=31378): Terminated: ok {rc=0} 10:54:34.238916 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31375): Process ended prematurely: osmo-stp_10.42.42.5(pid=31375) [trial-2373↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] [trial-2373↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 10:54:34.247730 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 10:54:34.274164 run osmo-hlr_10.42.42.2(pid=31372): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31372)] 10:54:34.321531 run osmo-hlr_10.42.42.2(pid=31372): stdout: | (launched: 2022-12-10_10:54:30.898889) 10:54:34.370557 run osmo-hlr_10.42.42.2(pid=31372): stderr: | 20221210105431211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105431211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105431211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105431211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105431211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105431211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105431227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105431243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105431244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105431244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:34.419848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Terminating (SIGTERM) 10:54:34.459328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Terminating (SIGTERM) 10:54:34.499339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31377): Terminating (SIGTERM) 10:54:34.539124 --- ParallelTerminationStrategy: PID 31371 died... 10:54:34.558189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Terminated: ok {rc=0} 10:54:34.601796 --- ParallelTerminationStrategy: PID 31374 died... 10:54:34.620290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Terminated: ok {rc=0} 10:54:34.663526 --- ParallelTerminationStrategy: PID 31377 died... 10:54:34.681949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31377): Terminated: ok {rc=0} 10:54:34.767191 bus /gobi_0: Setting Powered False 10:54:35.866337 bus /gobi_0: Setting Powered False 10:54:36.979237 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 sms:nanobts+band-900 --------------------------------------------------------------------- 10:54:38.224501 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:38.230233 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:54:38.264710 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:54:38.292156 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 10:54:38.345147 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:54:38.377970 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:54:38.405225 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 10:54:38.953540 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 10:54:38.958645 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:38.969709 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 10:54:39.017252 tst mo_mt_sms.py: using LAC 27899 10:54:39.140018 tst mo_mt_sms.py: using RAC 104 10:54:39.262587 tst mo_mt_sms.py: using CellId 27899 10:54:39.386687 tst mo_mt_sms.py: using BVCI 27900 10:54:39.500626 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:39.511632 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:39.522746 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:39.534005 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:39.545185 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:39.556116 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 10:54:39.669712 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 10:54:39.788221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:40.275860 run create_hlr_db(pid=31382): Launched 10:54:40.395578 bus /gobi_6: Setting Powered False 10:54:41.458316 run create_hlr_db(pid=31382): Terminated: ok {rc=0} 10:54:41.880547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31384): Launched 10:54:42.175171 run osmo-hlr_10.42.42.2(pid=31385): Launched 10:54:42.287123 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:42.796725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31387): Launched 10:54:43.090664 run osmo-stp_10.42.42.5(pid=31388): Launched 10:54:43.202760 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:43.734908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31390): Launched 10:54:44.029436 run osmo-msc_10.42.42.6(pid=31391): Launched 10:54:44.195525 run osmo-stp_10.42.42.5(pid=31388): ERR: Terminated: ERROR {rc=1} [trial-2373↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31388)] 10:54:44.320913 run osmo-stp_10.42.42.5(pid=31388): stdout: | (launched: 2022-12-10_10:54:43.037065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:44.446375 run osmo-stp_10.42.42.5(pid=31388): stderr: | 20221210105443205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105443205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105443205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105443206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105443206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105443206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105443207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:44.569674 run osmo-stp_10.42.42.5(pid=31388): stdout: | (launched: 2022-12-10_10:54:43.037065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:54:44.687227 run osmo-stp_10.42.42.5(pid=31388): stderr: | 20221210105443205 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105443205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105443205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105443206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105443206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105443206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105443207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:54:44.829290 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31388): Process ended prematurely: osmo-stp_10.42.42.5(pid=31388) [trial-2373↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31388)] [trial-2373↪sms:nanobts+band-900↪mo_mt_sms.py:16] 10:54:44.837453 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 10:54:44.863274 run osmo-hlr_10.42.42.2(pid=31385): ERR: Terminated: ERROR {rc=237} [trial-2373↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31385)] 10:54:44.910455 run osmo-hlr_10.42.42.2(pid=31385): stdout: | (launched: 2022-12-10_10:54:42.121518) 10:54:44.959134 run osmo-hlr_10.42.42.2(pid=31385): stderr: | 20221210105442296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105442296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105442296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105442296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105442296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105442296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105442308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105442317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105442317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105442317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:54:45.027130 run osmo-msc_10.42.42.6(pid=31391): ERR: Terminated: ERROR {rc=2} [trial-2373↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31391)] 10:54:45.074283 run osmo-msc_10.42.42.6(pid=31391): stdout: | (launched: 2022-12-10_10:54:43.975391) 10:54:45.122950 run osmo-msc_10.42.42.6(pid=31391): stderr: | 20221210105444246 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105444248 DLGLOBAL DEBUG validating counter group 0x7f7f2f107c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105444248 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105444248 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105444248 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105444248 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105444250 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105444250 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105444250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105444251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:54:45.172073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31384): Terminating (SIGTERM) 10:54:45.211384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31387): Terminating (SIGTERM) 10:54:45.250518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31390): Terminating (SIGTERM) 10:54:45.290187 --- ParallelTerminationStrategy: PID 31384 died... 10:54:45.309153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31384): Terminated: ok {rc=0} 10:54:45.352762 --- ParallelTerminationStrategy: PID 31387 died... 10:54:45.371233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31387): Terminated: ok {rc=0} 10:54:45.414464 --- ParallelTerminationStrategy: PID 31390 died... 10:54:45.432733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31390): Terminated: ok {rc=0} 10:54:45.519767 bus /sierra_3: Setting Powered False 10:54:46.630330 bus /sierra_3: Setting Powered False 10:54:47.763293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 10:54:49.000376 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:49.005431 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:54:49.039284 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 10:54:49.046312 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 10:54:49.082050 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:54:49.115718 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 10:54:49.122668 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 10:54:49.642010 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 10:54:49.647908 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 10:54:49.659983 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 10:54:49.708646 tst assert_extension.py: using LAC 27900 10:54:49.837074 tst assert_extension.py: using RAC 105 10:54:49.959494 tst assert_extension.py: using CellId 27900 10:54:50.081886 tst assert_extension.py: using BVCI 27901 10:54:50.195796 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 10:54:50.311999 tst assert_extension.py:10: start nitb and bts... 10:54:50.524665 run osmo-nitb_10.42.42.2: Starting osmo-nitb 10:54:51.166630 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31396): Launched 10:54:51.480938 run osmo-nitb_10.42.42.2(pid=31397): Launched 10:54:51.655974 run osmo-nitb_10.42.42.2(pid=31397): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31397)] 10:54:51.797465 run osmo-nitb_10.42.42.2(pid=31397): stdout: | (launched: 2022-12-10_10:54:51.424124) 10:54:51.940935 run osmo-nitb_10.42.42.2(pid=31397): stderr: | (launched: 2022-12-10_10:54:51.470967) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:54:52.087249 run osmo-nitb_10.42.42.2(pid=31397): stdout: | (launched: 2022-12-10_10:54:51.424124) 10:54:52.225152 run osmo-nitb_10.42.42.2(pid=31397): stderr: | (launched: 2022-12-10_10:54:51.470967) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31397) [trial-2373↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31397)] 10:54:52.600282 tst osmo-nitb_10.42.42.2(pid=31397): stdout: | (launched: 2022-12-10_10:54:51.424124) 10:54:52.728396 tst osmo-nitb_10.42.42.2(pid=31397): stderr: | (launched: 2022-12-10_10:54:51.470967) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 10:54:52.878897 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31397) [trial-2373↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31397)] [trial-2373↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 10:54:52.888018 tst assert_extension.py:12: Test FAILED (3.2 sec) 10:54:52.895192 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31396): Terminating (SIGTERM) 10:54:53.106800 --- ParallelTerminationStrategy: PID 31396 died... 10:54:53.128623 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31396): Terminated: ok {rc=0} 10:54:53.217176 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 ussd:nanobts+band-900 --------------------------------------------------------------------- 10:54:54.395027 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:54:54.399998 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:54:54.433648 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:54:54.461058 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 10:54:54.499104 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:54:54.532543 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:54:54.558867 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 10:54:55.088128 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 10:54:55.094068 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:55.105283 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 10:54:55.152635 tst assert_extension.py: using LAC 27901 10:54:55.275838 tst assert_extension.py: using RAC 106 10:54:55.397753 tst assert_extension.py: using CellId 27901 10:54:55.518799 tst assert_extension.py: using BVCI 27902 10:54:55.634720 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:55.645840 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:55.656782 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:55.667959 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:55.679207 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:54:55.690305 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 10:54:55.806844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:54:56.293773 run create_hlr_db(pid=31401): Launched 10:54:56.413650 bus /sierra_2: Setting Powered False 10:54:57.476294 run create_hlr_db(pid=31401): Terminated: ok {rc=0} 10:54:57.898770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31403): Launched 10:54:58.192603 run osmo-hlr_10.42.42.2(pid=31404): Launched 10:54:58.305511 run osmo-stp_10.42.42.5: Starting osmo-stp 10:54:58.816269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31406): Launched 10:54:59.111152 run osmo-stp_10.42.42.5(pid=31407): Launched 10:54:59.223540 run osmo-msc_10.42.42.6: Starting osmo-msc 10:54:59.754990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31409): Launched 10:55:00.050191 run osmo-msc_10.42.42.6(pid=31410): Launched 10:55:00.217226 run osmo-stp_10.42.42.5(pid=31407): ERR: Terminated: ERROR {rc=1} [trial-2373↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31407)] 10:55:00.341353 run osmo-stp_10.42.42.5(pid=31407): stdout: | (launched: 2022-12-10_10:54:59.057362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:00.465917 run osmo-stp_10.42.42.5(pid=31407): stderr: | 20221210105459227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105459227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105459227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105459228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105459228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105459228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105459229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:00.588180 run osmo-stp_10.42.42.5(pid=31407): stdout: | (launched: 2022-12-10_10:54:59.057362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:00.705467 run osmo-stp_10.42.42.5(pid=31407): stderr: | 20221210105459227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105459227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105459227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105459228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105459228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105459228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105459229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:00.853381 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31407): Process ended prematurely: osmo-stp_10.42.42.5(pid=31407) [trial-2373↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31407)] [trial-2373↪ussd:nanobts+band-900↪assert_extension.py:17] 10:55:00.862206 tst assert_extension.py:17: Test FAILED (5.8 sec) 10:55:00.894436 run osmo-hlr_10.42.42.2(pid=31404): ERR: Terminated: ERROR {rc=237} [trial-2373↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31404)] 10:55:00.943379 run osmo-hlr_10.42.42.2(pid=31404): stdout: | (launched: 2022-12-10_10:54:58.139224) 10:55:00.993641 run osmo-hlr_10.42.42.2(pid=31404): stderr: | 20221210105458313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105458313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105458313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105458313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105458313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105458313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105458329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105458338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105458338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105458338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:01.063722 run osmo-msc_10.42.42.6(pid=31410): ERR: Terminated: ERROR {rc=2} [trial-2373↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31410)] 10:55:01.112267 run osmo-msc_10.42.42.6(pid=31410): stdout: | (launched: 2022-12-10_10:54:59.995809) 10:55:01.162229 run osmo-msc_10.42.42.6(pid=31410): stderr: | 20221210105500268 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105500269 DLGLOBAL DEBUG validating counter group 0x7f52e666ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105500269 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105500269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105500269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105500269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105500271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105500271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105500271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105500271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:01.213403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31403): Terminating (SIGTERM) 10:55:01.254280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31406): Terminating (SIGTERM) 10:55:01.296466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31409): Terminating (SIGTERM) 10:55:01.338172 --- ParallelTerminationStrategy: PID 31403 died... 10:55:01.357280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31403): Terminated: ok {rc=0} 10:55:01.402450 --- ParallelTerminationStrategy: PID 31406 died... 10:55:01.421700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31406): Terminated: ok {rc=0} 10:55:01.466283 --- ParallelTerminationStrategy: PID 31409 died... 10:55:01.485435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31409): Terminated: ok {rc=0} 10:55:01.573926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 10:55:02.795862 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:02.804124 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 10:55:02.840205 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 10:55:02.866714 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 10:55:02.919552 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 10:55:02.951102 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 10:55:02.977088 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 10:55:03.528601 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 10:55:03.577440 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:03.588470 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:55:03.654636 tst mo_mt_call.py: using LAC 27902 10:55:03.773004 tst mo_mt_call.py: using RAC 107 10:55:03.891117 tst mo_mt_call.py: using CellId 27902 10:55:04.010359 tst mo_mt_call.py: using BVCI 27903 10:55:04.118897 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:04.130054 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:04.141028 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:04.151891 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:04.162901 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:04.173755 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:55:04.292520 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:55:04.409393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:04.873908 run create_hlr_db(pid=31418): Launched 10:55:04.996045 bus /sierra_2: Setting Powered False 10:55:06.056729 run create_hlr_db(pid=31418): Terminated: ok {rc=0} 10:55:06.493286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31420): Launched 10:55:06.813239 run osmo-hlr_10.42.42.2(pid=31421): Launched 10:55:06.935401 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:07.492187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31423): Launched 10:55:07.812860 run osmo-stp_10.42.42.5(pid=31424): Launched 10:55:07.935364 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:08.514157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31426): Launched 10:55:08.835520 run osmo-msc_10.42.42.6(pid=31427): Launched 10:55:09.014125 run osmo-stp_10.42.42.5(pid=31424): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31424)] 10:55:09.149948 run osmo-stp_10.42.42.5(pid=31424): stdout: | (launched: 2022-12-10_10:55:07.755138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:09.285955 run osmo-stp_10.42.42.5(pid=31424): stderr: | 20221210105507947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105507948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105507948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105507948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105507949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105507949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105507949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:09.421642 run osmo-stp_10.42.42.5(pid=31424): stdout: | (launched: 2022-12-10_10:55:07.755138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:09.549227 run osmo-stp_10.42.42.5(pid=31424): stderr: | 20221210105507947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105507948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105507948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105507948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105507949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105507949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105507949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:09.702157 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31424): Process ended prematurely: osmo-stp_10.42.42.5(pid=31424) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31424)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 10:55:09.711496 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:55:09.739757 run osmo-hlr_10.42.42.2(pid=31421): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31421)] 10:55:09.789918 run osmo-hlr_10.42.42.2(pid=31421): stdout: | (launched: 2022-12-10_10:55:06.755499) 10:55:09.841818 run osmo-hlr_10.42.42.2(pid=31421): stderr: | 20221210105506954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105506954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105506954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105506954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105506954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105506954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105506967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105506977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105506977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105506977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:09.914252 run osmo-msc_10.42.42.6(pid=31427): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31427)] 10:55:09.964313 run osmo-msc_10.42.42.6(pid=31427): stdout: | (launched: 2022-12-10_10:55:08.776900) 10:55:10.016173 run osmo-msc_10.42.42.6(pid=31427): stderr: | 20221210105509096 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105509097 DLGLOBAL DEBUG validating counter group 0x7f15bef81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105509097 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105509097 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105509097 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105509097 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105509099 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105509099 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105509099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105509099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:10.068723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31420): Terminating (SIGTERM) 10:55:10.110296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31423): Terminating (SIGTERM) 10:55:10.151965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31426): Terminating (SIGTERM) 10:55:10.194071 --- ParallelTerminationStrategy: PID 31420 died... 10:55:10.213930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31420): Terminated: ok {rc=0} 10:55:10.260280 --- ParallelTerminationStrategy: PID 31423 died... 10:55:10.279706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31423): Terminated: ok {rc=0} 10:55:10.326348 --- ParallelTerminationStrategy: PID 31426 died... 10:55:10.345748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31426): Terminated: ok {rc=0} 10:55:10.433680 bus /sierra_3: Setting Powered False 10:55:11.532769 bus /sierra_3: Setting Powered False 10:55:12.648707 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 10:55:13.791162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:13.803020 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 10:55:13.870245 tst mo_mt_call_osmux.py: using LAC 27903 10:55:13.992089 tst mo_mt_call_osmux.py: using RAC 108 10:55:14.109598 tst mo_mt_call_osmux.py: using CellId 27903 10:55:14.225711 tst mo_mt_call_osmux.py: using BVCI 27904 10:55:14.333806 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:14.344885 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:14.355811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:14.366795 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:14.377841 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 10:55:14.388642 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:55:14.505555 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 10:55:14.624421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:15.120710 run create_hlr_db(pid=31429): Launched 10:55:15.243959 bus /sierra_2: Setting Powered False 10:55:16.339662 run create_hlr_db(pid=31429): Terminated: ok {rc=0} 10:55:16.871959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31431): Launched 10:55:17.222117 run osmo-hlr_10.42.42.2(pid=31432): Launched 10:55:17.353480 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:17.905791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31434): Launched 10:55:18.229797 run osmo-stp_10.42.42.5(pid=31435): Launched 10:55:18.353050 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:18.935760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31437): Launched 10:55:19.259450 run osmo-msc_10.42.42.6(pid=31438): Launched 10:55:19.438719 run osmo-stp_10.42.42.5(pid=31435): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31435)] 10:55:19.573788 run osmo-stp_10.42.42.5(pid=31435): stdout: | (launched: 2022-12-10_10:55:18.171290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:19.709654 run osmo-stp_10.42.42.5(pid=31435): stderr: | 20221210105518364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105518364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105518365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105518365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105518366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105518366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105518366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:19.844832 run osmo-stp_10.42.42.5(pid=31435): stdout: | (launched: 2022-12-10_10:55:18.171290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:19.972615 run osmo-stp_10.42.42.5(pid=31435): stderr: | 20221210105518364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105518364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105518365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105518365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105518366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105518366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105518366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:20.126142 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31435): Process ended prematurely: osmo-stp_10.42.42.5(pid=31435) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31435)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 10:55:20.135636 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:55:20.163931 run osmo-hlr_10.42.42.2(pid=31432): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31432)] 10:55:20.213796 run osmo-hlr_10.42.42.2(pid=31432): stdout: | (launched: 2022-12-10_10:55:17.151267) 10:55:20.265457 run osmo-hlr_10.42.42.2(pid=31432): stderr: | 20221210105517361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105517361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105517361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105517361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105517361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105517361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105517374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105517383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105517383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105517383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:20.337542 run osmo-msc_10.42.42.6(pid=31438): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31438)] 10:55:20.387370 run osmo-msc_10.42.42.6(pid=31438): stdout: | (launched: 2022-12-10_10:55:19.201248) 10:55:20.438905 run osmo-msc_10.42.42.6(pid=31438): stderr: | 20221210105519523 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105519523 DLGLOBAL DEBUG validating counter group 0x7fd18961bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105519523 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105519523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105519523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105519523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105519525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105519525 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105519526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105519526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:20.490925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31431): Terminating (SIGTERM) 10:55:20.532659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31434): Terminating (SIGTERM) 10:55:20.574611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31437): Terminating (SIGTERM) 10:55:20.616840 --- ParallelTerminationStrategy: PID 31431 died... 10:55:20.636811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31431): Terminated: ok {rc=0} 10:55:20.683368 --- ParallelTerminationStrategy: PID 31434 died... 10:55:20.702787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31434): Terminated: ok {rc=0} 10:55:20.749319 --- ParallelTerminationStrategy: PID 31437 died... 10:55:20.768883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31437): Terminated: ok {rc=0} 10:55:20.857222 bus /sierra_3: Setting Powered False 10:55:21.955493 bus /sierra_3: Setting Powered False 10:55:23.071676 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 10:55:24.328242 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:24.336203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 10:55:24.370236 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 10:55:24.397551 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 10:55:24.451558 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 10:55:24.485530 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 10:55:24.512929 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 10:55:25.063659 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 10:55:25.115521 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:25.127083 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:55:25.194649 tst mo_mt_call.py: using LAC 27904 10:55:25.319452 tst mo_mt_call.py: using RAC 109 10:55:25.444464 tst mo_mt_call.py: using CellId 27904 10:55:25.573722 tst mo_mt_call.py: using BVCI 27905 10:55:25.691285 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:25.702871 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:25.714255 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:25.725924 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:25.737639 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:25.749798 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:55:25.864483 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:55:25.982789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:26.479729 run create_hlr_db(pid=31443): Launched 10:55:26.602672 bus /sierra_2: Setting Powered False 10:55:27.666381 run create_hlr_db(pid=31443): Terminated: ok {rc=0} 10:55:28.096145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31445): Launched 10:55:28.395443 run osmo-hlr_10.42.42.2(pid=31446): Launched 10:55:28.509856 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:29.027376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31448): Launched 10:55:29.328208 run osmo-stp_10.42.42.5(pid=31449): Launched 10:55:29.443126 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:29.986052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31451): Launched 10:55:30.286116 run osmo-msc_10.42.42.6(pid=31452): Launched 10:55:30.453899 run osmo-stp_10.42.42.5(pid=31449): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31449)] 10:55:30.580796 run osmo-stp_10.42.42.5(pid=31449): stdout: | (launched: 2022-12-10_10:55:29.273533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:30.707546 run osmo-stp_10.42.42.5(pid=31449): stderr: | 20221210105529442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105529442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105529442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105529442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105529446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105529446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105529446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:30.836116 run osmo-stp_10.42.42.5(pid=31449): stdout: | (launched: 2022-12-10_10:55:29.273533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:31.001937 run osmo-stp_10.42.42.5(pid=31449): stderr: | 20221210105529442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105529442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105529442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105529442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105529446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105529446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105529446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:31.165031 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31449): Process ended prematurely: osmo-stp_10.42.42.5(pid=31449) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31449)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 10:55:31.175482 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 10:55:31.206830 run osmo-hlr_10.42.42.2(pid=31446): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31446)] 10:55:31.260301 run osmo-hlr_10.42.42.2(pid=31446): stdout: | (launched: 2022-12-10_10:55:28.341283) 10:55:31.314364 run osmo-hlr_10.42.42.2(pid=31446): stderr: | 20221210105528517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105528517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105528517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105528517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105528517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105528517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105528534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105528544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105528544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105528544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:31.390090 run osmo-msc_10.42.42.6(pid=31452): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31452)] 10:55:31.442451 run osmo-msc_10.42.42.6(pid=31452): stdout: | (launched: 2022-12-10_10:55:30.231632) 10:55:31.497111 run osmo-msc_10.42.42.6(pid=31452): stderr: | 20221210105530500 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105530500 DLGLOBAL DEBUG validating counter group 0x7fc9139f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105530501 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105530501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105530501 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105530501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105530504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105530504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105530504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105530504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:31.551769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31445): Terminating (SIGTERM) 10:55:31.597106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31448): Terminating (SIGTERM) 10:55:31.643832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31451): Terminating (SIGTERM) 10:55:31.691730 --- ParallelTerminationStrategy: PID 31445 died... 10:55:31.712725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31445): Terminated: ok {rc=0} 10:55:31.763569 --- ParallelTerminationStrategy: PID 31448 died... 10:55:31.784090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31448): Terminated: ok {rc=0} 10:55:31.833890 --- ParallelTerminationStrategy: PID 31451 died... 10:55:31.856796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31451): Terminated: ok {rc=0} 10:55:31.948117 bus /sierra_3: Setting Powered False 10:55:33.045219 bus /sierra_3: Setting Powered False 10:55:34.159535 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 10:55:35.313828 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:35.325713 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 10:55:35.392772 tst mo_mt_call_osmux.py: using LAC 27905 10:55:35.510968 tst mo_mt_call_osmux.py: using RAC 110 10:55:35.630892 tst mo_mt_call_osmux.py: using CellId 27905 10:55:35.751037 tst mo_mt_call_osmux.py: using BVCI 27906 10:55:35.861536 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:35.872594 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:35.883624 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:35.894534 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:35.905483 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 10:55:35.916266 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:55:36.030647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 10:55:36.147281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:36.645080 run create_hlr_db(pid=31454): Launched 10:55:36.768699 bus /sierra_2: Setting Powered False 10:55:37.832705 run create_hlr_db(pid=31454): Terminated: ok {rc=0} 10:55:38.260896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31456): Launched 10:55:38.560719 run osmo-hlr_10.42.42.2(pid=31457): Launched 10:55:38.676761 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:39.199782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31459): Launched 10:55:39.499173 run osmo-stp_10.42.42.5(pid=31460): Launched 10:55:39.614475 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:40.157352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31462): Launched 10:55:40.456502 run osmo-msc_10.42.42.6(pid=31463): Launched 10:55:40.625704 run osmo-stp_10.42.42.5(pid=31460): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31460)] 10:55:40.752373 run osmo-stp_10.42.42.5(pid=31460): stdout: | (launched: 2022-12-10_10:55:39.444491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:40.879609 run osmo-stp_10.42.42.5(pid=31460): stderr: | 20221210105539615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105539615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105539616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105539616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105539616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105539617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105539617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:41.005206 run osmo-stp_10.42.42.5(pid=31460): stdout: | (launched: 2022-12-10_10:55:39.444491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:41.125448 run osmo-stp_10.42.42.5(pid=31460): stderr: | 20221210105539615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105539615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105539616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105539616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105539616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105539617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105539617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:41.268207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31460): Process ended prematurely: osmo-stp_10.42.42.5(pid=31460) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31460)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 10:55:41.277013 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:55:41.303131 run osmo-hlr_10.42.42.2(pid=31457): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31457)] 10:55:41.350232 run osmo-hlr_10.42.42.2(pid=31457): stdout: | (launched: 2022-12-10_10:55:38.506084) 10:55:41.398771 run osmo-hlr_10.42.42.2(pid=31457): stderr: | 20221210105538681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105538682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105538682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105538682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105538682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105538682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105538694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105538703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105538703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105538703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:41.466893 run osmo-msc_10.42.42.6(pid=31463): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31463)] 10:55:41.513712 run osmo-msc_10.42.42.6(pid=31463): stdout: | (launched: 2022-12-10_10:55:40.401664) 10:55:41.562408 run osmo-msc_10.42.42.6(pid=31463): stderr: | 20221210105540671 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105540671 DLGLOBAL DEBUG validating counter group 0x7f3bb8019c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105540671 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105540671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105540671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105540672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105540673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105540674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105540674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105540674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:41.611303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31456): Terminating (SIGTERM) 10:55:41.650329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31459): Terminating (SIGTERM) 10:55:41.689240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31462): Terminating (SIGTERM) 10:55:41.728395 --- ParallelTerminationStrategy: PID 31456 died... 10:55:41.747358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31456): Terminated: ok {rc=0} 10:55:41.790763 --- ParallelTerminationStrategy: PID 31459 died... 10:55:41.809388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31459): Terminated: ok {rc=0} 10:55:41.853346 --- ParallelTerminationStrategy: PID 31462 died... 10:55:41.872146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31462): Terminated: ok {rc=0} 10:55:41.957362 bus /sierra_3: Setting Powered False 10:55:43.053463 bus /sierra_3: Setting Powered False 10:55:44.173195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 10:55:45.419627 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:55:45.426876 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 10:55:45.458696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 10:55:45.485153 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 10:55:45.537710 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 10:55:45.569923 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 10:55:45.596121 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 10:55:46.168176 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 10:55:46.235927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:46.249777 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:55:46.320619 tst mo_mt_call.py: using LAC 27906 10:55:46.451393 tst mo_mt_call.py: using RAC 111 10:55:46.580655 tst mo_mt_call.py: using CellId 27906 10:55:46.711703 tst mo_mt_call.py: using BVCI 27907 10:55:46.831976 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:46.844644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:46.860015 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:46.873843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:46.887409 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:46.900055 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:55:47.048117 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:55:47.192829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:47.693394 run create_hlr_db(pid=31469): Launched 10:55:47.817474 bus /sierra_2: Setting Powered False 10:55:48.881330 run create_hlr_db(pid=31469): Terminated: ok {rc=0} 10:55:49.326513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31471): Launched 10:55:49.647133 run osmo-hlr_10.42.42.2(pid=31472): Launched 10:55:49.770014 run osmo-stp_10.42.42.5: Starting osmo-stp 10:55:50.326558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31474): Launched 10:55:50.646699 run osmo-stp_10.42.42.5(pid=31475): Launched 10:55:50.768885 run osmo-msc_10.42.42.6: Starting osmo-msc 10:55:51.350080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31477): Launched 10:55:51.671404 run osmo-msc_10.42.42.6(pid=31478): Launched 10:55:51.850535 run osmo-stp_10.42.42.5(pid=31475): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31475)] 10:55:51.985854 run osmo-stp_10.42.42.5(pid=31475): stdout: | (launched: 2022-12-10_10:55:50.588561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:52.123028 run osmo-stp_10.42.42.5(pid=31475): stderr: | 20221210105550780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105550780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105550781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105550781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105550781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105550781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105550782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:52.258331 run osmo-stp_10.42.42.5(pid=31475): stdout: | (launched: 2022-12-10_10:55:50.588561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:55:52.386091 run osmo-stp_10.42.42.5(pid=31475): stderr: | 20221210105550780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105550780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105550781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105550781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105550781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105550781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105550782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:55:52.538480 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31475): Process ended prematurely: osmo-stp_10.42.42.5(pid=31475) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31475)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 10:55:52.547895 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 10:55:52.575990 run osmo-hlr_10.42.42.2(pid=31472): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31472)] 10:55:52.626222 run osmo-hlr_10.42.42.2(pid=31472): stdout: | (launched: 2022-12-10_10:55:49.589124) 10:55:52.677981 run osmo-hlr_10.42.42.2(pid=31472): stderr: | 20221210105549786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105549786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105549786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105549786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105549787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105549787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105549803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105549812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105549813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105549813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:55:52.750325 run osmo-msc_10.42.42.6(pid=31478): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31478)] 10:55:52.800342 run osmo-msc_10.42.42.6(pid=31478): stdout: | (launched: 2022-12-10_10:55:51.613299) 10:55:52.851915 run osmo-msc_10.42.42.6(pid=31478): stderr: | 20221210105551936 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105551936 DLGLOBAL DEBUG validating counter group 0x7f4a7bba3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105551936 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105551936 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105551936 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105551937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105551938 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105551939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105551939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105551939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:55:52.904001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31471): Terminating (SIGTERM) 10:55:52.945554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31474): Terminating (SIGTERM) 10:55:52.987212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31477): Terminating (SIGTERM) 10:55:53.029440 --- ParallelTerminationStrategy: PID 31471 died... 10:55:53.049165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31471): Terminated: ok {rc=0} 10:55:53.095695 --- ParallelTerminationStrategy: PID 31474 died... 10:55:53.115147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31474): Terminated: ok {rc=0} 10:55:53.161604 --- ParallelTerminationStrategy: PID 31477 died... 10:55:53.181053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31477): Terminated: ok {rc=0} 10:55:53.268543 bus /sierra_3: Setting Powered False 10:55:54.367026 bus /sierra_3: Setting Powered False 10:55:55.481653 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 10:55:56.627587 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:56.639476 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 10:55:56.706000 tst mo_mt_call_osmux.py: using LAC 27907 10:55:56.821928 tst mo_mt_call_osmux.py: using RAC 112 10:55:56.940289 tst mo_mt_call_osmux.py: using CellId 27907 10:55:57.057272 tst mo_mt_call_osmux.py: using BVCI 27908 10:55:57.166456 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:57.177922 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:57.189035 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:57.200078 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:57.211283 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 10:55:57.222478 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:55:57.336204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 10:55:57.458410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:55:57.956441 run create_hlr_db(pid=31480): Launched 10:55:58.079945 bus /sierra_2: Setting Powered False 10:55:59.143755 run create_hlr_db(pid=31480): Terminated: ok {rc=0} 10:55:59.573395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31482): Launched 10:55:59.875456 run osmo-hlr_10.42.42.2(pid=31483): Launched 10:55:59.990806 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:00.524311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31485): Launched 10:56:00.824457 run osmo-stp_10.42.42.5(pid=31486): Launched 10:56:01.032604 run osmo-msc_10.42.42.6: Starting osmo-msc 10:56:01.895233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31488): Launched 10:56:02.245849 run osmo-msc_10.42.42.6(pid=31489): Launched 10:56:02.532368 run osmo-stp_10.42.42.5(pid=31486): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31486)] 10:56:02.670743 run osmo-stp_10.42.42.5(pid=31486): stdout: | (launched: 2022-12-10_10:56:00.770085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:02.808109 run osmo-stp_10.42.42.5(pid=31486): stderr: | 20221210105601065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105601066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105601066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105601068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105601073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105601073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105601073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:02.943208 run osmo-stp_10.42.42.5(pid=31486): stdout: | (launched: 2022-12-10_10:56:00.770085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:03.072045 run osmo-stp_10.42.42.5(pid=31486): stderr: | 20221210105601065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105601066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105601066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105601068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105601073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105601073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105601073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:03.226370 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31486): Process ended prematurely: osmo-stp_10.42.42.5(pid=31486) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31486)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 10:56:03.235918 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 10:56:03.264689 run osmo-hlr_10.42.42.2(pid=31483): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31483)] 10:56:03.315357 run osmo-hlr_10.42.42.2(pid=31483): stdout: | (launched: 2022-12-10_10:55:59.820753) 10:56:03.367594 run osmo-hlr_10.42.42.2(pid=31483): stderr: | 20221210105559993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105559994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105559994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105559994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105559994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105559994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105600006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105600014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105600015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105600015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:03.440377 run osmo-msc_10.42.42.6(pid=31489): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31489)] 10:56:03.490764 run osmo-msc_10.42.42.6(pid=31489): stdout: | (launched: 2022-12-10_10:56:02.172593) 10:56:03.543457 run osmo-msc_10.42.42.6(pid=31489): stderr: | 20221210105602563 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105602564 DLGLOBAL DEBUG validating counter group 0x7f68e4d0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105602564 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105602564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105602564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105602564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105602566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105602566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105602566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105602566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:56:03.596255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31482): Terminating (SIGTERM) 10:56:03.638748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31485): Terminating (SIGTERM) 10:56:03.681030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31488): Terminating (SIGTERM) 10:56:03.723780 --- ParallelTerminationStrategy: PID 31482 died... 10:56:03.743956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31482): Terminated: ok {rc=0} 10:56:03.791190 --- ParallelTerminationStrategy: PID 31485 died... 10:56:03.811017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31485): Terminated: ok {rc=0} 10:56:03.857949 --- ParallelTerminationStrategy: PID 31488 died... 10:56:03.877887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31488): Terminated: ok {rc=0} 10:56:03.967253 bus /sierra_3: Setting Powered False 10:56:05.065343 bus /sierra_3: Setting Powered False 10:56:06.180860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 10:56:07.429875 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:56:07.436836 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 10:56:07.468688 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 10:56:07.495058 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 10:56:07.547124 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 10:56:07.579293 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 10:56:07.605637 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 10:56:08.156844 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 10:56:08.204559 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:08.215814 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:56:08.281772 tst mo_mt_call.py: using LAC 27908 10:56:08.401193 tst mo_mt_call.py: using RAC 113 10:56:08.520822 tst mo_mt_call.py: using CellId 27908 10:56:08.636858 tst mo_mt_call.py: using BVCI 27909 10:56:08.744416 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:08.755656 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:08.766632 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:08.777611 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:08.788555 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:08.799541 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:56:08.918132 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:56:09.034808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:09.496291 run create_hlr_db(pid=31494): Launched 10:56:09.618183 bus /sierra_2: Setting Powered False 10:56:10.677927 run create_hlr_db(pid=31494): Terminated: ok {rc=0} 10:56:11.094945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31496): Launched 10:56:11.395650 run osmo-hlr_10.42.42.2(pid=31497): Launched 10:56:11.508652 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:12.025257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31499): Launched 10:56:12.325449 run osmo-stp_10.42.42.5(pid=31500): Launched 10:56:12.440238 run osmo-msc_10.42.42.6: Starting osmo-msc 10:56:12.984098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31502): Launched 10:56:13.284630 run osmo-msc_10.42.42.6(pid=31503): Launched 10:56:13.452440 run osmo-stp_10.42.42.5(pid=31500): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31500)] 10:56:13.579195 run osmo-stp_10.42.42.5(pid=31500): stdout: | (launched: 2022-12-10_10:56:12.270792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:13.706503 run osmo-stp_10.42.42.5(pid=31500): stderr: | 20221210105612441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105612441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105612442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105612442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105612442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105612443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105612443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:13.831165 run osmo-stp_10.42.42.5(pid=31500): stdout: | (launched: 2022-12-10_10:56:12.270792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:13.950129 run osmo-stp_10.42.42.5(pid=31500): stderr: | 20221210105612441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105612441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105612442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105612442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105612442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105612443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105612443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:14.092812 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31500): Process ended prematurely: osmo-stp_10.42.42.5(pid=31500) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31500)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 10:56:14.101548 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 10:56:14.127733 run osmo-hlr_10.42.42.2(pid=31497): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31497)] 10:56:14.175340 run osmo-hlr_10.42.42.2(pid=31497): stdout: | (launched: 2022-12-10_10:56:11.341326) 10:56:14.224630 run osmo-hlr_10.42.42.2(pid=31497): stderr: | 20221210105611518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105611518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105611518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105611518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105611518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105611518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105611531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105611539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105611539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105611539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:14.293004 run osmo-msc_10.42.42.6(pid=31503): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31503)] 10:56:14.340282 run osmo-msc_10.42.42.6(pid=31503): stdout: | (launched: 2022-12-10_10:56:13.229344) 10:56:14.389208 run osmo-msc_10.42.42.6(pid=31503): stderr: | 20221210105613499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105613500 DLGLOBAL DEBUG validating counter group 0x7fda4804cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105613500 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105613500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105613500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105613500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105613502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105613502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105613503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105613503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:56:14.438211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31496): Terminating (SIGTERM) 10:56:14.477281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31499): Terminating (SIGTERM) 10:56:14.516431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31502): Terminating (SIGTERM) 10:56:14.556100 --- ParallelTerminationStrategy: PID 31496 died... 10:56:14.575031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31496): Terminated: ok {rc=0} 10:56:14.618693 --- ParallelTerminationStrategy: PID 31499 died... 10:56:14.637164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31499): Terminated: ok {rc=0} 10:56:14.680823 --- ParallelTerminationStrategy: PID 31502 died... 10:56:14.699607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31502): Terminated: ok {rc=0} 10:56:14.784455 bus /sierra_3: Setting Powered False 10:56:15.900733 bus /sierra_3: Setting Powered False 10:56:17.045870 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 10:56:18.201609 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:18.213830 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 10:56:18.282168 tst mo_mt_call_osmux.py: using LAC 27909 10:56:18.402576 tst mo_mt_call_osmux.py: using RAC 114 10:56:18.520018 tst mo_mt_call_osmux.py: using CellId 27909 10:56:18.639524 tst mo_mt_call_osmux.py: using BVCI 27910 10:56:18.750518 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:18.761814 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:18.772716 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:18.783777 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:18.794785 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 10:56:18.806077 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:56:18.923893 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 10:56:19.040905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:19.508188 run create_hlr_db(pid=31505): Launched 10:56:19.630767 bus /sierra_2: Setting Powered False 10:56:20.690982 run create_hlr_db(pid=31505): Terminated: ok {rc=0} 10:56:21.129598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31507): Launched 10:56:21.451702 run osmo-hlr_10.42.42.2(pid=31508): Launched 10:56:21.575266 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:22.133997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31510): Launched 10:56:22.455174 run osmo-stp_10.42.42.5(pid=31511): Launched 10:56:22.579346 run osmo-msc_10.42.42.6: Starting osmo-msc 10:56:23.161189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31513): Launched 10:56:23.482981 run osmo-msc_10.42.42.6(pid=31514): Launched 10:56:23.663230 run osmo-stp_10.42.42.5(pid=31511): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31511)] 10:56:23.799468 run osmo-stp_10.42.42.5(pid=31511): stdout: | (launched: 2022-12-10_10:56:22.397538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:23.936594 run osmo-stp_10.42.42.5(pid=31511): stderr: | 20221210105622587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105622587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105622588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105622588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105622588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105622589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105622589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:24.072430 run osmo-stp_10.42.42.5(pid=31511): stdout: | (launched: 2022-12-10_10:56:22.397538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:24.201279 run osmo-stp_10.42.42.5(pid=31511): stderr: | 20221210105622587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105622587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105622588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105622588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105622588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105622589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105622589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:24.354994 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31511): Process ended prematurely: osmo-stp_10.42.42.5(pid=31511) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31511)] [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 10:56:24.364541 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 10:56:24.393228 run osmo-hlr_10.42.42.2(pid=31508): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31508)] 10:56:24.442991 run osmo-hlr_10.42.42.2(pid=31508): stdout: | (launched: 2022-12-10_10:56:21.393726) 10:56:24.494711 run osmo-hlr_10.42.42.2(pid=31508): stderr: | 20221210105621591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105621591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105621591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105621591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105621591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105621592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105621606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105621616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105621617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105621617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:24.567189 run osmo-msc_10.42.42.6(pid=31514): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31514)] 10:56:24.617245 run osmo-msc_10.42.42.6(pid=31514): stdout: | (launched: 2022-12-10_10:56:23.424767) 10:56:24.668877 run osmo-msc_10.42.42.6(pid=31514): stderr: | 20221210105623745 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105623745 DLGLOBAL DEBUG validating counter group 0x7ff493745c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105623745 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105623745 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105623745 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105623746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105623747 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105623748 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105623748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105623748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:56:24.721221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31507): Terminating (SIGTERM) 10:56:24.763323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31510): Terminating (SIGTERM) 10:56:24.805439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31513): Terminating (SIGTERM) 10:56:24.847695 --- ParallelTerminationStrategy: PID 31507 died... 10:56:24.867719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31507): Terminated: ok {rc=0} 10:56:24.914452 --- ParallelTerminationStrategy: PID 31510 died... 10:56:24.934062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31510): Terminated: ok {rc=0} 10:56:24.980374 --- ParallelTerminationStrategy: PID 31513 died... 10:56:25.000044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31513): Terminated: ok {rc=0} 10:56:25.087910 bus /sierra_3: Setting Powered False 10:56:26.186465 bus /sierra_3: Setting Powered False 10:56:27.302755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 10:56:28.551524 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:56:28.559100 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 10:56:28.591268 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 10:56:28.617571 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 10:56:28.673381 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 10:56:28.705337 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 10:56:28.731781 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 10:56:29.282994 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 10:56:29.335910 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:29.347794 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:56:29.414838 tst mo_mt_call.py: using LAC 27910 10:56:29.539903 tst mo_mt_call.py: using RAC 115 10:56:29.665383 tst mo_mt_call.py: using CellId 27910 10:56:29.789360 tst mo_mt_call.py: using BVCI 27911 10:56:29.906253 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:29.917997 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:29.929629 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:29.941622 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:29.953755 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:29.965527 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:56:30.083915 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:56:30.202496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:30.669476 run create_hlr_db(pid=31519): Launched 10:56:30.792475 bus /sierra_2: Setting Powered False 10:56:31.871960 run create_hlr_db(pid=31519): Terminated: ok {rc=0} 10:56:32.345879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31521): Launched 10:56:32.647744 run osmo-hlr_10.42.42.2(pid=31522): Launched 10:56:32.762481 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:33.298774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31524): Launched 10:56:33.599339 run osmo-stp_10.42.42.5(pid=31525): Launched 10:56:33.714129 run osmo-msc_10.42.42.6: Starting osmo-msc 10:56:34.289450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31527): Launched 10:56:34.613185 run osmo-msc_10.42.42.6(pid=31528): Launched 10:56:34.792596 run osmo-stp_10.42.42.5(pid=31525): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31525)] 10:56:34.928636 run osmo-stp_10.42.42.5(pid=31525): stdout: | (launched: 2022-12-10_10:56:33.544752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:35.065549 run osmo-stp_10.42.42.5(pid=31525): stderr: | 20221210105633714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105633714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105633714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105633715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105633715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105633715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105633715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:35.201550 run osmo-stp_10.42.42.5(pid=31525): stdout: | (launched: 2022-12-10_10:56:33.544752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:35.329387 run osmo-stp_10.42.42.5(pid=31525): stderr: | 20221210105633714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105633714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105633714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105633715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105633715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105633715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105633715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:35.482913 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31525): Process ended prematurely: osmo-stp_10.42.42.5(pid=31525) [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31525)] [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 10:56:35.492516 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:56:35.520756 run osmo-hlr_10.42.42.2(pid=31522): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31522)] 10:56:35.571173 run osmo-hlr_10.42.42.2(pid=31522): stdout: | (launched: 2022-12-10_10:56:32.592915) 10:56:35.622954 run osmo-hlr_10.42.42.2(pid=31522): stderr: | 20221210105632771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105632771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105632771 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105632771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105632771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105632772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105632783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105632792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105632793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105632793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:35.695126 run osmo-msc_10.42.42.6(pid=31528): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31528)] 10:56:35.745052 run osmo-msc_10.42.42.6(pid=31528): stdout: | (launched: 2022-12-10_10:56:34.555109) 10:56:35.796663 run osmo-msc_10.42.42.6(pid=31528): stderr: | 20221210105634876 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105634876 DLGLOBAL DEBUG validating counter group 0x7ff76ef28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105634876 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105634876 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105634877 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105634877 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105634878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105634879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105634879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105634879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:56:35.848643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31521): Terminating (SIGTERM) 10:56:35.890650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31524): Terminating (SIGTERM) 10:56:35.932867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31527): Terminating (SIGTERM) 10:56:35.976600 --- ParallelTerminationStrategy: PID 31521 died... 10:56:35.997178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31521): Terminated: ok {rc=0} 10:56:36.044055 --- ParallelTerminationStrategy: PID 31524 died... 10:56:36.064048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31524): Terminated: ok {rc=0} 10:56:36.111098 --- ParallelTerminationStrategy: PID 31527 died... 10:56:36.130716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31527): Terminated: ok {rc=0} 10:56:36.219153 bus /sierra_3: Setting Powered False 10:56:37.317460 bus /sierra_3: Setting Powered False 10:56:38.432403 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 10:56:39.580497 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:39.592786 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 10:56:39.662166 tst mo_mt_call_osmux.py: using LAC 27911 10:56:39.789767 tst mo_mt_call_osmux.py: using RAC 116 10:56:39.919114 tst mo_mt_call_osmux.py: using CellId 27911 10:56:40.043795 tst mo_mt_call_osmux.py: using BVCI 27912 10:56:40.160634 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:40.172412 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:40.184028 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:40.195755 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:40.207526 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 10:56:40.219223 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:56:40.338124 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 10:56:40.453421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:40.918556 run create_hlr_db(pid=31530): Launched 10:56:41.041494 bus /sierra_2: Setting Powered False 10:56:42.101867 run create_hlr_db(pid=31530): Terminated: ok {rc=0} 10:56:42.519449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31532): Launched 10:56:42.818941 run osmo-hlr_10.42.42.2(pid=31533): Launched 10:56:42.932582 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:43.464770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31535): Launched 10:56:43.766639 run osmo-stp_10.42.42.5(pid=31536): Launched 10:56:43.882125 run osmo-msc_10.42.42.6: Starting osmo-msc 10:56:44.423799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31538): Launched 10:56:44.723178 run osmo-msc_10.42.42.6(pid=31539): Launched 10:56:44.891099 run osmo-stp_10.42.42.5(pid=31536): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31536)] 10:56:45.017547 run osmo-stp_10.42.42.5(pid=31536): stdout: | (launched: 2022-12-10_10:56:43.712119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:45.144403 run osmo-stp_10.42.42.5(pid=31536): stderr: | 20221210105643880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105643880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105643880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105643881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105643882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105643882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105643882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:45.269421 run osmo-stp_10.42.42.5(pid=31536): stdout: | (launched: 2022-12-10_10:56:43.712119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:45.388106 run osmo-stp_10.42.42.5(pid=31536): stderr: | 20221210105643880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105643880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105643880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105643881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105643882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105643882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105643882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:45.531226 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31536): Process ended prematurely: osmo-stp_10.42.42.5(pid=31536) [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31536)] [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 10:56:45.540057 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 10:56:45.566275 run osmo-hlr_10.42.42.2(pid=31533): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31533)] 10:56:45.613526 run osmo-hlr_10.42.42.2(pid=31533): stdout: | (launched: 2022-12-10_10:56:42.764581) 10:56:45.662558 run osmo-hlr_10.42.42.2(pid=31533): stderr: | 20221210105642944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105642944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105642944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105642944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105642944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105642944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105642954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105642963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105642963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105642963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:45.730913 run osmo-msc_10.42.42.6(pid=31539): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31539)] 10:56:45.777954 run osmo-msc_10.42.42.6(pid=31539): stdout: | (launched: 2022-12-10_10:56:44.668614) 10:56:45.826736 run osmo-msc_10.42.42.6(pid=31539): stderr: | 20221210105644939 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105644939 DLGLOBAL DEBUG validating counter group 0x7fb7487b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105644939 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105644939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105644940 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105644940 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105644943 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105644943 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105644943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105644943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:56:45.901737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31532): Terminating (SIGTERM) 10:56:45.941782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31535): Terminating (SIGTERM) 10:56:45.981650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31538): Terminating (SIGTERM) 10:56:46.022087 --- ParallelTerminationStrategy: PID 31532 died... 10:56:46.041109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31532): Terminated: ok {rc=0} 10:56:46.085613 --- ParallelTerminationStrategy: PID 31535 died... 10:56:46.104746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31535): Terminated: ok {rc=0} 10:56:46.149287 --- ParallelTerminationStrategy: PID 31538 died... 10:56:46.168280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31538): Terminated: ok {rc=0} 10:56:46.253680 bus /sierra_3: Setting Powered False 10:56:47.349067 bus /sierra_3: Setting Powered False 10:56:48.461778 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 10:56:49.711624 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:56:49.718449 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 10:56:49.750486 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 10:56:49.776921 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 10:56:49.829997 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 10:56:49.862371 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 10:56:49.893343 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 10:56:50.439834 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 10:56:50.487587 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:56:50.499007 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:56:50.548607 tst mo_mt_call.py: using LAC 27912 10:56:50.667694 tst mo_mt_call.py: using RAC 117 10:56:50.786870 tst mo_mt_call.py: using CellId 27912 10:56:50.908616 tst mo_mt_call.py: using BVCI 27913 10:56:51.016921 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:56:51.028410 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:56:51.039505 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:56:51.050574 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:56:51.061853 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:56:51.072846 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:56:51.193287 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:56:51.313302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:56:51.781152 run create_hlr_db(pid=31544): Launched 10:56:51.904643 bus /sierra_2: Setting Powered False 10:56:52.965106 run create_hlr_db(pid=31544): Terminated: ok {rc=0} 10:56:53.403838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31546): Launched 10:56:53.725420 run osmo-hlr_10.42.42.2(pid=31547): Launched 10:56:53.848672 run osmo-stp_10.42.42.5: Starting osmo-stp 10:56:54.402992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31549): Launched 10:56:54.724696 run osmo-stp_10.42.42.5(pid=31550): Launched 10:56:54.847530 run osmo-msc_10.42.42.6: Starting osmo-msc 10:56:55.426263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31552): Launched 10:56:55.747635 run osmo-msc_10.42.42.6(pid=31553): Launched 10:56:55.926764 run osmo-stp_10.42.42.5(pid=31550): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31550)] 10:56:56.062066 run osmo-stp_10.42.42.5(pid=31550): stdout: | (launched: 2022-12-10_10:56:54.666782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:56.199330 run osmo-stp_10.42.42.5(pid=31550): stderr: | 20221210105654860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105654860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105654860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105654860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105654861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105654861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105654861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:56.334906 run osmo-stp_10.42.42.5(pid=31550): stdout: | (launched: 2022-12-10_10:56:54.666782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:56:56.462621 run osmo-stp_10.42.42.5(pid=31550): stderr: | 20221210105654860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105654860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105654860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105654860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105654861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105654861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105654861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:56:56.615361 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31550): Process ended prematurely: osmo-stp_10.42.42.5(pid=31550) [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31550)] [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 10:56:56.624682 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 10:56:56.652666 run osmo-hlr_10.42.42.2(pid=31547): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31547)] 10:56:56.703313 run osmo-hlr_10.42.42.2(pid=31547): stdout: | (launched: 2022-12-10_10:56:53.667693) 10:56:56.754887 run osmo-hlr_10.42.42.2(pid=31547): stderr: | 20221210105653865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105653865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105653866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105653866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105653866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105653866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105653878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105653886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105653886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105653886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:56:56.826836 run osmo-msc_10.42.42.6(pid=31553): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31553)] 10:56:56.877109 run osmo-msc_10.42.42.6(pid=31553): stdout: | (launched: 2022-12-10_10:56:55.689690) 10:56:56.928549 run osmo-msc_10.42.42.6(pid=31553): stderr: | 20221210105656009 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105656009 DLGLOBAL DEBUG validating counter group 0x7f04db717c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105656009 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105656009 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105656009 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105656010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105656011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105656012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105656012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105656012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:56:56.980672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31546): Terminating (SIGTERM) 10:56:57.022493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31549): Terminating (SIGTERM) 10:56:57.064427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31552): Terminating (SIGTERM) 10:56:57.107141 --- ParallelTerminationStrategy: PID 31546 died... 10:56:57.127107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31546): Terminated: ok {rc=0} 10:56:57.173690 --- ParallelTerminationStrategy: PID 31549 died... 10:56:57.193228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31549): Terminated: ok {rc=0} 10:56:57.239781 --- ParallelTerminationStrategy: PID 31552 died... 10:56:57.259311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31552): Terminated: ok {rc=0} 10:56:57.348365 bus /sierra_3: Setting Powered False 10:56:58.444785 bus /sierra_3: Setting Powered False 10:56:59.559260 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 10:57:00.709603 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:57:00.722201 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 10:57:00.774397 tst mo_mt_call_osmux.py: using LAC 27913 10:57:00.925050 tst mo_mt_call_osmux.py: using RAC 118 10:57:01.051226 tst mo_mt_call_osmux.py: using CellId 27913 10:57:01.209314 tst mo_mt_call_osmux.py: using BVCI 27914 10:57:01.330143 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:57:01.342615 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:57:01.355211 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:57:01.368362 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:57:01.381083 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 10:57:01.393627 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:57:01.514433 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 10:57:01.640939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:02.138006 run create_hlr_db(pid=31555): Launched 10:57:02.292303 bus /sierra_2: Setting Powered False 10:57:03.353249 run create_hlr_db(pid=31555): Terminated: ok {rc=0} 10:57:03.796397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31557): Launched 10:57:04.117806 run osmo-hlr_10.42.42.2(pid=31558): Launched 10:57:04.241587 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:04.796522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31560): Launched 10:57:05.119718 run osmo-stp_10.42.42.5(pid=31561): Launched 10:57:05.243143 run osmo-msc_10.42.42.6: Starting osmo-msc 10:57:05.824828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31563): Launched 10:57:06.148085 run osmo-msc_10.42.42.6(pid=31564): Launched 10:57:06.327532 run osmo-stp_10.42.42.5(pid=31561): ERR: Terminated: ERROR {rc=1} [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31561)] 10:57:06.463369 run osmo-stp_10.42.42.5(pid=31561): stdout: | (launched: 2022-12-10_10:57:05.060769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:06.599631 run osmo-stp_10.42.42.5(pid=31561): stderr: | 20221210105705251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105705251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105705252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105705252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105705253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105705253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105705253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:06.735684 run osmo-stp_10.42.42.5(pid=31561): stdout: | (launched: 2022-12-10_10:57:05.060769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:06.863969 run osmo-stp_10.42.42.5(pid=31561): stderr: | 20221210105705251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105705251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105705252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105705252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105705253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105705253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105705253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:07.017750 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31561): Process ended prematurely: osmo-stp_10.42.42.5(pid=31561) [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31561)] [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 10:57:07.027360 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 10:57:07.056227 run osmo-hlr_10.42.42.2(pid=31558): ERR: Terminated: ERROR {rc=237} [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31558)] 10:57:07.107368 run osmo-hlr_10.42.42.2(pid=31558): stdout: | (launched: 2022-12-10_10:57:04.059720) 10:57:07.159732 run osmo-hlr_10.42.42.2(pid=31558): stderr: | 20221210105704258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105704258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105704258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105704258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105704258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105704258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105704270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105704278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105704278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105704278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:07.232553 run osmo-msc_10.42.42.6(pid=31564): ERR: Terminated: ERROR {rc=2} [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31564)] 10:57:07.282997 run osmo-msc_10.42.42.6(pid=31564): stdout: | (launched: 2022-12-10_10:57:06.089068) 10:57:07.335174 run osmo-msc_10.42.42.6(pid=31564): stderr: | 20221210105706413 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105706413 DLGLOBAL DEBUG validating counter group 0x7fad5771cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105706413 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105706413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105706413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105706414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105706415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105706416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105706416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105706416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:57:07.387770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31557): Terminating (SIGTERM) 10:57:07.430245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31560): Terminating (SIGTERM) 10:57:07.472619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31563): Terminating (SIGTERM) 10:57:07.517114 --- ParallelTerminationStrategy: PID 31557 died... 10:57:07.536325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31557): Terminated: ok {rc=0} 10:57:07.581750 --- ParallelTerminationStrategy: PID 31560 died... 10:57:07.600410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31560): Terminated: ok {rc=0} 10:57:07.646330 --- ParallelTerminationStrategy: PID 31563 died... 10:57:07.666342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31563): Terminated: ok {rc=0} 10:57:07.752591 bus /sierra_3: Setting Powered False 10:57:08.851796 bus /sierra_3: Setting Powered False 10:57:09.970452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 emergency:nanobts+band-900 --------------------------------------------------------------------- 10:57:11.225225 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:11.230426 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:57:11.262151 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 10:57:11.288283 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 10:57:11.371841 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:57:11.403482 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 10:57:11.429688 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 10:57:12.015097 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2373 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 10:57:12.019967 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:12.030708 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 10:57:12.078595 tst emergency_mo_mt_call.py: using LAC 27914 10:57:12.195769 tst emergency_mo_mt_call.py: using RAC 119 10:57:12.322114 tst emergency_mo_mt_call.py: using CellId 27914 10:57:12.445393 tst emergency_mo_mt_call.py: using BVCI 27915 10:57:12.552503 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:12.563697 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:12.574419 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:12.585119 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:12.595708 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:12.606315 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:12.724514 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:12.838081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:13.297654 run create_hlr_db(pid=31569): Launched 10:57:13.419134 bus /sierra_2: Setting Powered False 10:57:14.478590 run create_hlr_db(pid=31569): Terminated: ok {rc=0} 10:57:14.912502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Launched 10:57:15.228628 run osmo-hlr_10.42.42.2(pid=31572): Launched 10:57:15.350432 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:15.919709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Launched 10:57:16.261050 run osmo-stp_10.42.42.5(pid=31575): Launched 10:57:16.492082 tst emergency_mo_mt_call.py: using MSISDN 7693 10:57:16.800384 run osmo-msc_10.42.42.6: Starting osmo-msc 10:57:17.437543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31577): Launched 10:57:17.755587 run osmo-msc_10.42.42.6(pid=31578): Launched 10:57:17.933285 run osmo-stp_10.42.42.5(pid=31575): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] 10:57:18.067497 run osmo-stp_10.42.42.5(pid=31575): stdout: | (launched: 2022-12-10_10:57:16.193860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:18.203131 run osmo-stp_10.42.42.5(pid=31575): stderr: | 20221210105716537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105716537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105716539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105716541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105716547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105716547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105716547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:18.337373 run osmo-stp_10.42.42.5(pid=31575): stdout: | (launched: 2022-12-10_10:57:16.193860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:18.464933 run osmo-stp_10.42.42.5(pid=31575): stderr: | 20221210105716537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105716537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105716539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105716541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105716547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105716547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105716547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:18.616625 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31575): Process ended prematurely: osmo-stp_10.42.42.5(pid=31575) [trial-2373↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] [trial-2373↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 10:57:18.625810 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 10:57:18.653849 run osmo-hlr_10.42.42.2(pid=31572): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31572)] 10:57:18.704700 run osmo-hlr_10.42.42.2(pid=31572): stdout: | (launched: 2022-12-10_10:57:15.171833) 10:57:18.757164 run osmo-hlr_10.42.42.2(pid=31572): stderr: | 20221210105715369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105715369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105715369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105715369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105715369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105715370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105715383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105715393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105715393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105715393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:18.829996 run osmo-msc_10.42.42.6(pid=31578): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31578)] 10:57:18.880624 run osmo-msc_10.42.42.6(pid=31578): stdout: | (launched: 2022-12-10_10:57:17.698366) 10:57:18.932894 run osmo-msc_10.42.42.6(pid=31578): stderr: | 20221210105718020 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105718020 DLGLOBAL DEBUG validating counter group 0x7f9291cd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105718020 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105718020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105718020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105718020 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105718022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105718023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105718023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105718023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:57:18.985644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Terminating (SIGTERM) 10:57:19.027961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Terminating (SIGTERM) 10:57:19.070577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31577): Terminating (SIGTERM) 10:57:19.113531 --- ParallelTerminationStrategy: PID 31571 died... 10:57:19.133742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31571): Terminated: ok {rc=0} 10:57:19.181206 --- ParallelTerminationStrategy: PID 31574 died... 10:57:19.201036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31574): Terminated: ok {rc=0} 10:57:19.247884 --- ParallelTerminationStrategy: PID 31577 died... 10:57:19.267635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31577): Terminated: ok {rc=0} 10:57:19.357132 bus /sierra_3: Setting Powered False 10:57:20.455620 bus /sierra_3: Setting Powered False 10:57:21.572373 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 10:57:22.658972 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:22.670922 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 10:57:22.723716 tst emergency_preemptive_call.py: using LAC 27915 10:57:22.849876 tst emergency_preemptive_call.py: using RAC 120 10:57:22.974709 tst emergency_preemptive_call.py: using CellId 27915 10:57:23.100651 tst emergency_preemptive_call.py: using BVCI 27916 10:57:23.216451 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:23.227895 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:23.239091 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:23.250880 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:23.262756 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 10:57:23.274676 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:23.391672 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:23.508127 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:23.620489 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:23.734376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:24.193875 run create_hlr_db(pid=31580): Launched 10:57:24.315784 bus /sierra_2: Setting Powered False 10:57:25.374527 run create_hlr_db(pid=31580): Terminated: ok {rc=0} 10:57:25.809067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31582): Launched 10:57:26.125484 run osmo-hlr_10.42.42.2(pid=31583): Launched 10:57:26.246939 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:26.795837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31585): Launched 10:57:27.111997 run osmo-stp_10.42.42.5(pid=31586): Launched 10:57:27.243998 tst emergency_preemptive_call.py: using MSISDN 7694 10:57:27.407728 run osmo-msc_10.42.42.6: Starting osmo-msc 10:57:27.975402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31588): Launched 10:57:28.292024 run osmo-msc_10.42.42.6(pid=31589): Launched 10:57:28.469312 run osmo-stp_10.42.42.5(pid=31586): ERR: Terminated: ERROR {rc=1} [trial-2373↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31586)] 10:57:28.603361 run osmo-stp_10.42.42.5(pid=31586): stdout: | (launched: 2022-12-10_10:57:27.054857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:28.739176 run osmo-stp_10.42.42.5(pid=31586): stderr: | 20221210105727245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105727245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105727245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105727246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105727246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105727246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105727246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:28.873136 run osmo-stp_10.42.42.5(pid=31586): stdout: | (launched: 2022-12-10_10:57:27.054857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:28.999492 run osmo-stp_10.42.42.5(pid=31586): stderr: | 20221210105727245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105727245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105727245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105727246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105727246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105727246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105727246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:29.151244 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31586): Process ended prematurely: osmo-stp_10.42.42.5(pid=31586) [trial-2373↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31586)] [trial-2373↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 10:57:29.160201 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 10:57:29.188639 run osmo-hlr_10.42.42.2(pid=31583): ERR: Terminated: ERROR {rc=237} [trial-2373↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31583)] 10:57:29.238773 run osmo-hlr_10.42.42.2(pid=31583): stdout: | (launched: 2022-12-10_10:57:26.068101) 10:57:29.290888 run osmo-hlr_10.42.42.2(pid=31583): stderr: | 20221210105726264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105726264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105726264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105726264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105726264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105726264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105726276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105726284 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105726284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105726284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:29.363651 run osmo-msc_10.42.42.6(pid=31589): ERR: Terminated: ERROR {rc=2} [trial-2373↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31589)] 10:57:29.413411 run osmo-msc_10.42.42.6(pid=31589): stdout: | (launched: 2022-12-10_10:57:28.234691) 10:57:29.464912 run osmo-msc_10.42.42.6(pid=31589): stderr: | 20221210105728554 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210105728554 DLGLOBAL DEBUG validating counter group 0x7ff7aa945c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210105728554 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210105728554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210105728554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210105728555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210105728556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210105728557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210105728557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210105728557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 10:57:29.517222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31582): Terminating (SIGTERM) 10:57:29.559549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31585): Terminating (SIGTERM) 10:57:29.601943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31588): Terminating (SIGTERM) 10:57:29.644221 --- ParallelTerminationStrategy: PID 31582 died... 10:57:29.664304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31582): Terminated: ok {rc=0} 10:57:29.711557 --- ParallelTerminationStrategy: PID 31585 died... 10:57:29.731190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31585): Terminated: ok {rc=0} 10:57:29.777794 --- ParallelTerminationStrategy: PID 31588 died... 10:57:29.797458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31588): Terminated: ok {rc=0} 10:57:29.885969 bus /sierra_9: Setting Powered False 10:57:30.984604 bus /sierra_9: Setting Powered False 10:57:32.122404 bus /sierra_8: Setting Powered False 10:57:33.232999 bus /sierra_8: Setting Powered False 10:57:34.347086 bus /sierra_3: Setting Powered False 10:57:35.447801 bus /sierra_3: Setting Powered False 10:57:36.563489 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900 --------------------------------------------------------------------- 10:57:37.846877 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:57:37.853717 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 10:57:37.888506 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 10:57:37.928458 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 10:57:38.016443 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 10:57:38.049362 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 10:57:38.087903 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 10:57:38.677989 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 10:57:38.732783 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:38.743895 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 10:57:38.790659 tst cs_paging_gprs_active.py: using LAC 27916 10:57:38.914983 tst cs_paging_gprs_active.py: using RAC 121 10:57:39.038577 tst cs_paging_gprs_active.py: using CellId 27916 10:57:39.163662 tst cs_paging_gprs_active.py: using BVCI 27917 10:57:39.274479 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.285352 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.295972 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.306642 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.317169 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.327778 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.338617 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.349029 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:39.359568 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:39.477264 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:39.596222 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:57:39.812080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:40.136740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31596): Launched 10:57:40.418173 run iperf3-srv_10.42.42.10(pid=31597): Launched 10:57:40.539290 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:57:40.756404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:41.078962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31598): Launched 10:57:41.360192 run iperf3-srv_10.42.42.10(pid=31599): Launched 10:57:41.481427 tst cs_paging_gprs_active.py:38: start network... 10:57:41.699164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:42.200736 run create_hlr_db(pid=31600): Launched 10:57:42.324673 bus /sierra_2: Setting Powered False 10:57:43.389236 run create_hlr_db(pid=31600): Terminated: ok {rc=0} 10:57:43.820810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31602): Launched 10:57:44.124358 run osmo-hlr_10.42.42.2(pid=31603): Launched 10:57:44.239961 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:44.759977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31605): Launched 10:57:45.060811 run osmo-stp_10.42.42.5(pid=31606): Launched 10:57:45.176929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:45.697955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31608): Launched 10:57:45.813421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:46.117666 run patchelf(pid=31609): Launched 10:57:46.298283 run osmo-stp_10.42.42.5(pid=31606): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31606)] 10:57:46.428483 run osmo-stp_10.42.42.5(pid=31606): stdout: | (launched: 2022-12-10_10:57:45.006033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:46.559721 run osmo-stp_10.42.42.5(pid=31606): stderr: | 20221210105745178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105745178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105745178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105745179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105745179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105745179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105745179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:46.691474 run osmo-stp_10.42.42.5(pid=31606): stdout: | (launched: 2022-12-10_10:57:45.006033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:46.817098 run osmo-stp_10.42.42.5(pid=31606): stderr: | 20221210105745178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105745178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105745178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105745179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105745179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105745179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105745179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:46.966089 run patchelf(pid=31609): Terminating (SIGINT) 10:57:47.139514 run patchelf(pid=31609): Terminated: ok {rc=0} 10:57:47.263377 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31606): Process ended prematurely: osmo-stp_10.42.42.5(pid=31606) [trial-2373↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31606)] [trial-2373↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 10:57:47.272604 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:57:47.299634 run osmo-hlr_10.42.42.2(pid=31603): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31603)] 10:57:47.346944 run osmo-hlr_10.42.42.2(pid=31603): stdout: | (launched: 2022-12-10_10:57:44.069173) 10:57:47.396280 run osmo-hlr_10.42.42.2(pid=31603): stderr: | 20221210105744246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105744246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105744246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105744246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105744247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105744247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105744259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105744268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105744269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105744269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:47.446018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31596): Terminating (SIGTERM) 10:57:47.485807 run iperf3-srv_10.42.42.10(pid=31597): Terminating (SIGTERM) 10:57:47.525584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31598): Terminating (SIGTERM) 10:57:47.565759 run iperf3-srv_10.42.42.10(pid=31599): Terminating (SIGTERM) 10:57:47.605604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31602): Terminating (SIGTERM) 10:57:47.645370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31605): Terminating (SIGTERM) 10:57:47.684869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31608): Terminating (SIGTERM) 10:57:47.724760 --- ParallelTerminationStrategy: PID 31596 died... 10:57:47.743918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31596): Terminated: ok {rc=0} 10:57:47.787929 --- ParallelTerminationStrategy: PID 31597 died... 10:57:47.806526 run iperf3-srv_10.42.42.10(pid=31597): Terminated {rc=256} 10:57:47.850298 --- ParallelTerminationStrategy: PID 31598 died... 10:57:47.868895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31598): Terminated: ok {rc=0} 10:57:47.912488 --- ParallelTerminationStrategy: PID 31599 died... 10:57:47.930979 run iperf3-srv_10.42.42.10(pid=31599): Terminated {rc=256} 10:57:47.974666 --- ParallelTerminationStrategy: PID 31602 died... 10:57:47.993288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31602): Terminated: ok {rc=0} 10:57:48.037417 --- ParallelTerminationStrategy: PID 31605 died... 10:57:48.056062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31605): Terminated: ok {rc=0} 10:57:48.100154 --- ParallelTerminationStrategy: PID 31608 died... 10:57:48.118818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31608): Terminated: ok {rc=0} 10:57:48.204768 bus /gobi_0: Setting Powered False 10:57:49.304688 bus /gobi_0: Setting Powered False 10:57:50.419749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 10:57:51.565510 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:51.576609 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 10:57:51.626813 tst iperf3.py: using LAC 27917 10:57:51.745302 tst iperf3.py: using RAC 122 10:57:51.864702 tst iperf3.py: using CellId 27917 10:57:51.987977 tst iperf3.py: using BVCI 27918 10:57:52.098673 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.109628 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.120532 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.131168 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.141787 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.152299 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.163049 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.173671 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:57:52.184135 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:57:52.302269 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:57:52.519785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:57:52.842356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31610): Launched 10:57:53.124063 run iperf3-srv_10.42.42.10(pid=31611): Launched 10:57:53.246440 tst iperf3.py:8: start network... 10:57:53.465147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:57:53.964073 run create_hlr_db(pid=31612): Launched 10:57:54.088020 bus /gobi_6: Setting Powered False 10:57:55.152864 run create_hlr_db(pid=31612): Terminated: ok {rc=0} 10:57:55.585332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31614): Launched 10:57:55.888505 run osmo-hlr_10.42.42.2(pid=31615): Launched 10:57:56.004711 run osmo-stp_10.42.42.5: Starting osmo-stp 10:57:56.541730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31617): Launched 10:57:56.844015 run osmo-stp_10.42.42.5(pid=31618): Launched 10:57:56.959328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:57:57.479546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31620): Launched 10:57:57.596159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:57:57.850626 run patchelf(pid=31621): Launched 10:57:58.019303 run osmo-stp_10.42.42.5(pid=31618): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31618)] 10:57:58.148641 run osmo-stp_10.42.42.5(pid=31618): stdout: | (launched: 2022-12-10_10:57:56.789104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:58.279114 run osmo-stp_10.42.42.5(pid=31618): stderr: | 20221210105756960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105756960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105756960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105756961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105756961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105756961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105756962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:58.409418 run osmo-stp_10.42.42.5(pid=31618): stdout: | (launched: 2022-12-10_10:57:56.789104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:57:58.533830 run osmo-stp_10.42.42.5(pid=31618): stderr: | 20221210105756960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105756960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105756960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105756961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105756961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105756961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105756962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:57:58.680829 run patchelf(pid=31621): Terminating (SIGINT) 10:57:58.851202 run patchelf(pid=31621): Terminated: ok {rc=0} 10:57:58.973850 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31618): Process ended prematurely: osmo-stp_10.42.42.5(pid=31618) [trial-2373↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31618)] [trial-2373↪gprs:nanobts+band-900↪iperf3.py:8] 10:57:58.983178 tst iperf3.py:8: Test FAILED (7.5 sec) 10:57:59.010315 run osmo-hlr_10.42.42.2(pid=31615): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31615)] 10:57:59.058006 run osmo-hlr_10.42.42.2(pid=31615): stdout: | (launched: 2022-12-10_10:57:55.833781) 10:57:59.107366 run osmo-hlr_10.42.42.2(pid=31615): stderr: | 20221210105756011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105756011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105756011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105756011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105756011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105756011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105756024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105756034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105756035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105756035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:57:59.157266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31610): Terminating (SIGTERM) 10:57:59.197061 run iperf3-srv_10.42.42.10(pid=31611): Terminating (SIGTERM) 10:57:59.237102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31614): Terminating (SIGTERM) 10:57:59.277102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31617): Terminating (SIGTERM) 10:57:59.316810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31620): Terminating (SIGTERM) 10:57:59.357508 --- ParallelTerminationStrategy: PID 31610 died... 10:57:59.376483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31610): Terminated: ok {rc=0} 10:57:59.420737 --- ParallelTerminationStrategy: PID 31611 died... 10:57:59.439467 run iperf3-srv_10.42.42.10(pid=31611): Terminated {rc=256} 10:57:59.483539 --- ParallelTerminationStrategy: PID 31614 died... 10:57:59.502332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31614): Terminated: ok {rc=0} 10:57:59.546309 --- ParallelTerminationStrategy: PID 31617 died... 10:57:59.565157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31617): Terminated: ok {rc=0} 10:57:59.609256 --- ParallelTerminationStrategy: PID 31620 died... 10:57:59.627916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31620): Terminated: ok {rc=0} 10:57:59.712179 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 10:58:00.875565 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:00.887917 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 10:58:00.943818 tst iperf3m4.py: using LAC 27918 10:58:01.069187 tst iperf3m4.py: using RAC 123 10:58:01.225417 tst iperf3m4.py: using CellId 27918 10:58:01.347841 tst iperf3m4.py: using BVCI 27919 10:58:01.495773 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.510786 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.525412 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.539405 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.554196 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.569199 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.584066 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.597474 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:01.610597 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:58:01.744418 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:58:01.904464 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:58:02.057866 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:58:02.174793 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:58:02.387698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:02.690482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31622): Launched 10:58:02.953083 run iperf3-srv_10.42.42.10(pid=31623): Launched 10:58:03.065990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:58:03.267630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:03.568753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31624): Launched 10:58:03.830720 run iperf3-srv_10.42.42.10(pid=31625): Launched 10:58:03.943666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:58:04.145804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:04.447793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31626): Launched 10:58:04.710556 run iperf3-srv_10.42.42.10(pid=31627): Launched 10:58:04.823546 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:58:05.025170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:05.327041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31628): Launched 10:58:05.589549 run iperf3-srv_10.42.42.10(pid=31629): Launched 10:58:05.703241 tst iperf3m4.py:8: start network... 10:58:05.905069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:06.374057 run create_hlr_db(pid=31630): Launched 10:58:06.498563 bus /gobi_6: Setting Powered False 10:58:07.560132 run create_hlr_db(pid=31630): Terminated: ok {rc=0} 10:58:07.981543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31632): Launched 10:58:08.286577 run osmo-hlr_10.42.42.2(pid=31633): Launched 10:58:08.402331 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:08.924804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31635): Launched 10:58:09.228129 run osmo-stp_10.42.42.5(pid=31636): Launched 10:58:09.343787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:09.884573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31638): Launched 10:58:10.000351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:10.255465 run patchelf(pid=31639): Launched 10:58:10.423707 run osmo-stp_10.42.42.5(pid=31636): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31636)] 10:58:10.551800 run osmo-stp_10.42.42.5(pid=31636): stdout: | (launched: 2022-12-10_10:58:09.172912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:10.680837 run osmo-stp_10.42.42.5(pid=31636): stderr: | 20221210105809343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105809343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105809344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105809344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105809345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105809345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105809345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:10.810355 run osmo-stp_10.42.42.5(pid=31636): stdout: | (launched: 2022-12-10_10:58:09.172912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:10.933516 run osmo-stp_10.42.42.5(pid=31636): stderr: | 20221210105809343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105809343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105809344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105809344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105809345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105809345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105809345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:11.079945 run patchelf(pid=31639): Terminating (SIGINT) 10:58:11.250021 run patchelf(pid=31639): Terminated: ok {rc=0} 10:58:11.372837 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31636): Process ended prematurely: osmo-stp_10.42.42.5(pid=31636) [trial-2373↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31636)] [trial-2373↪gprs:nanobts+band-900↪iperf3m4.py:8] 10:58:11.382543 tst iperf3m4.py:8: Test FAILED (10.6 sec) 10:58:11.410252 run osmo-hlr_10.42.42.2(pid=31633): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31633)] 10:58:11.458004 run osmo-hlr_10.42.42.2(pid=31633): stdout: | (launched: 2022-12-10_10:58:08.231157) 10:58:11.507494 run osmo-hlr_10.42.42.2(pid=31633): stderr: | 20221210105808405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105808405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105808405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105808405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105808405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105808405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105808417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105808426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105808426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105808426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:11.557383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31622): Terminating (SIGTERM) 10:58:11.597365 run iperf3-srv_10.42.42.10(pid=31623): Terminating (SIGTERM) 10:58:11.637138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31624): Terminating (SIGTERM) 10:58:11.677031 run iperf3-srv_10.42.42.10(pid=31625): Terminating (SIGTERM) 10:58:11.716641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31626): Terminating (SIGTERM) 10:58:11.756526 run iperf3-srv_10.42.42.10(pid=31627): Terminating (SIGTERM) 10:58:11.796212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31628): Terminating (SIGTERM) 10:58:11.836018 run iperf3-srv_10.42.42.10(pid=31629): Terminating (SIGTERM) 10:58:11.875805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31632): Terminating (SIGTERM) 10:58:11.915609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31635): Terminating (SIGTERM) 10:58:11.955365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31638): Terminating (SIGTERM) 10:58:11.995529 --- ParallelTerminationStrategy: PID 31622 died... 10:58:12.014772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31622): Terminated: ok {rc=0} 10:58:12.058909 --- ParallelTerminationStrategy: PID 31623 died... 10:58:12.077617 run iperf3-srv_10.42.42.10(pid=31623): Terminated {rc=256} 10:58:12.121423 --- ParallelTerminationStrategy: PID 31624 died... 10:58:12.140119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31624): Terminated: ok {rc=0} 10:58:12.183840 --- ParallelTerminationStrategy: PID 31625 died... 10:58:12.202752 run iperf3-srv_10.42.42.10(pid=31625): Terminated {rc=256} 10:58:12.246533 --- ParallelTerminationStrategy: PID 31626 died... 10:58:12.265296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31626): Terminated: ok {rc=0} 10:58:12.308839 --- ParallelTerminationStrategy: PID 31627 died... 10:58:12.327742 run iperf3-srv_10.42.42.10(pid=31627): Terminated {rc=256} 10:58:12.371892 --- ParallelTerminationStrategy: PID 31628 died... 10:58:12.390576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31628): Terminated: ok {rc=0} 10:58:12.434266 --- ParallelTerminationStrategy: PID 31629 died... 10:58:12.453012 run iperf3-srv_10.42.42.10(pid=31629): Terminated {rc=256} 10:58:12.496517 --- ParallelTerminationStrategy: PID 31632 died... 10:58:12.515219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31632): Terminated: ok {rc=0} 10:58:12.558848 --- ParallelTerminationStrategy: PID 31635 died... 10:58:12.577558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31635): Terminated: ok {rc=0} 10:58:12.621353 --- ParallelTerminationStrategy: PID 31638 died... 10:58:12.640138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31638): Terminated: ok {rc=0} 10:58:12.725400 bus /gobi_4: Setting Powered False 10:58:13.825683 bus /gobi_4: Setting Powered False 10:58:14.941008 bus /gobi_1: Setting Powered False 10:58:16.042416 bus /gobi_1: Setting Powered False 10:58:17.164864 bus /gobi_0: Setting Powered False 10:58:18.263531 bus /gobi_0: Setting Powered False 10:58:19.383276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900 ping.py ---------------------------------------------- 10:58:20.486448 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:20.497776 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 10:58:20.547914 tst ping.py: using LAC 27919 10:58:20.673164 tst ping.py: using RAC 124 10:58:20.799743 tst ping.py: using CellId 27919 10:58:20.922824 tst ping.py: using BVCI 27920 10:58:21.038400 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:21.049822 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:21.060923 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:21.072020 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:21.082951 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:21.093769 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:21.104864 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:21.116744 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:58:21.230944 tst ping.py:19: start network... 10:58:21.429983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:21.889875 run create_hlr_db(pid=31640): Launched 10:58:22.010770 bus /gobi_6: Setting Powered False 10:58:23.070402 run create_hlr_db(pid=31640): Terminated: ok {rc=0} 10:58:23.484756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Launched 10:58:23.781676 run osmo-hlr_10.42.42.2(pid=31643): Launched 10:58:23.894079 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:24.408261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31645): Launched 10:58:24.704335 run osmo-stp_10.42.42.5(pid=31646): Launched 10:58:24.817138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:25.330197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31648): Launched 10:58:25.443760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:25.693576 run patchelf(pid=31649): Launched 10:58:25.859626 run osmo-stp_10.42.42.5(pid=31646): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31646)] 10:58:25.985888 run osmo-stp_10.42.42.5(pid=31646): stdout: | (launched: 2022-12-10_10:58:24.650306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:26.113386 run osmo-stp_10.42.42.5(pid=31646): stderr: | 20221210105824818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105824818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105824818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105824819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105824821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105824821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105824821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:26.241325 run osmo-stp_10.42.42.5(pid=31646): stdout: | (launched: 2022-12-10_10:58:24.650306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:26.363634 run osmo-stp_10.42.42.5(pid=31646): stderr: | 20221210105824818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105824818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105824818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105824819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105824821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105824821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105824821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:26.507538 run patchelf(pid=31649): Terminating (SIGINT) 10:58:26.674749 run patchelf(pid=31649): Terminated: ok {rc=0} 10:58:26.794887 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31646): Process ended prematurely: osmo-stp_10.42.42.5(pid=31646) [trial-2373↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31646)] [trial-2373↪gprs:nanobts+band-900↪ping.py:22] 10:58:26.803588 tst ping.py:22: Test FAILED (6.3 sec) 10:58:26.830618 run osmo-hlr_10.42.42.2(pid=31643): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31643)] 10:58:26.878282 run osmo-hlr_10.42.42.2(pid=31643): stdout: | (launched: 2022-12-10_10:58:23.727299) 10:58:26.927516 run osmo-hlr_10.42.42.2(pid=31643): stderr: | 20221210105823902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105823902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105823902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105823902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105823902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105823902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105823914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105823924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105823925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105823925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:26.977121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Terminating (SIGTERM) 10:58:27.016630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31645): Terminating (SIGTERM) 10:58:27.056404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31648): Terminating (SIGTERM) 10:58:27.096434 --- ParallelTerminationStrategy: PID 31642 died... 10:58:27.115826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Terminated: ok {rc=0} 10:58:27.160024 --- ParallelTerminationStrategy: PID 31645 died... 10:58:27.178857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31645): Terminated: ok {rc=0} 10:58:27.222833 --- ParallelTerminationStrategy: PID 31648 died... 10:58:27.241524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31648): Terminated: ok {rc=0} 10:58:27.325172 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 10:58:28.409343 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:28.420368 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 10:58:28.468102 tst ping_idle_ping.py: using LAC 27920 10:58:28.586979 tst ping_idle_ping.py: using RAC 125 10:58:28.706099 tst ping_idle_ping.py: using CellId 27920 10:58:28.824385 tst ping_idle_ping.py: using BVCI 27921 10:58:28.942826 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:28.954273 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:28.965570 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:28.977704 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:28.990010 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:29.001674 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:29.013802 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 10:58:29.025904 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 10:58:29.145256 tst ping_idle_ping.py:24: start network... 10:58:29.345402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:29.807443 run create_hlr_db(pid=31650): Launched 10:58:29.928865 bus /gobi_6: Setting Powered False 10:58:30.992815 run create_hlr_db(pid=31650): Terminated: ok {rc=0} 10:58:31.434082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31653): Launched 10:58:31.760727 run osmo-hlr_10.42.42.2(pid=31654): Launched 10:58:31.955966 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:32.591138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31656): Launched 10:58:32.909996 run osmo-stp_10.42.42.5(pid=31657): Launched 10:58:33.031692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:33.583352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31659): Launched 10:58:33.706140 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:33.973899 run patchelf(pid=31660): Launched 10:58:34.150722 run osmo-stp_10.42.42.5(pid=31657): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31657)] 10:58:34.285279 run osmo-stp_10.42.42.5(pid=31657): stdout: | (launched: 2022-12-10_10:58:32.852385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:34.421986 run osmo-stp_10.42.42.5(pid=31657): stderr: | 20221210105833041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105833041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105833042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105833042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105833044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105833045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105833045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:34.558765 run osmo-stp_10.42.42.5(pid=31657): stdout: | (launched: 2022-12-10_10:58:32.852385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:34.688761 run osmo-stp_10.42.42.5(pid=31657): stderr: | 20221210105833041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105833041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105833042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105833042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105833044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105833045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105833045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:34.843421 run patchelf(pid=31660): Terminating (SIGINT) 10:58:35.021623 run patchelf(pid=31660): Terminated: ok {rc=0} 10:58:35.150999 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31657): Process ended prematurely: osmo-stp_10.42.42.5(pid=31657) [trial-2373↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31657)] [trial-2373↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 10:58:35.160470 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 10:58:35.189555 run osmo-hlr_10.42.42.2(pid=31654): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31654)] 10:58:35.239976 run osmo-hlr_10.42.42.2(pid=31654): stdout: | (launched: 2022-12-10_10:58:31.688355) 10:58:35.291922 run osmo-hlr_10.42.42.2(pid=31654): stderr: | 20221210105832062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105832062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105832062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105832062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105832063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105832063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105832087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105832099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105832099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105832100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:35.344512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31653): Terminating (SIGTERM) 10:58:35.386715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31656): Terminating (SIGTERM) 10:58:35.429014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31659): Terminating (SIGTERM) 10:58:35.471606 --- ParallelTerminationStrategy: PID 31653 died... 10:58:35.491725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31653): Terminated: ok {rc=0} 10:58:35.538685 --- ParallelTerminationStrategy: PID 31656 died... 10:58:35.558387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31656): Terminated: ok {rc=0} 10:58:35.605112 --- ParallelTerminationStrategy: PID 31659 died... 10:58:35.624684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31659): Terminated: ok {rc=0} 10:58:35.712819 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 10:58:37.013638 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:58:37.019727 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 10:58:37.052039 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 10:58:37.090603 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 10:58:37.176815 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 10:58:37.208775 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 10:58:37.246882 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 10:58:37.847012 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 10:58:37.896240 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:37.907265 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:58:37.957306 tst cs_paging_gprs_active.py: using LAC 27921 10:58:38.077285 tst cs_paging_gprs_active.py: using RAC 126 10:58:38.195669 tst cs_paging_gprs_active.py: using CellId 27921 10:58:38.324510 tst cs_paging_gprs_active.py: using BVCI 27922 10:58:38.442595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.454207 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.465378 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.476846 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.488116 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.499569 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.510975 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.522531 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:38.534083 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:58:38.652490 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:58:38.771675 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:58:38.992477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:39.318325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31664): Launched 10:58:39.600877 run iperf3-srv_10.42.42.10(pid=31665): Launched 10:58:39.722646 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:58:39.942142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:40.268862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31666): Launched 10:58:40.550292 run iperf3-srv_10.42.42.10(pid=31667): Launched 10:58:40.671434 tst cs_paging_gprs_active.py:38: start network... 10:58:40.889838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:41.391242 run create_hlr_db(pid=31668): Launched 10:58:41.514917 bus /gobi_6: Setting Powered False 10:58:42.578905 run create_hlr_db(pid=31668): Terminated: ok {rc=0} 10:58:43.011179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31670): Launched 10:58:43.314016 run osmo-hlr_10.42.42.2(pid=31671): Launched 10:58:43.429818 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:43.951303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31673): Launched 10:58:44.253674 run osmo-stp_10.42.42.5(pid=31674): Launched 10:58:44.369790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:44.893266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31676): Launched 10:58:45.009517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:45.264078 run patchelf(pid=31677): Launched 10:58:45.434931 run osmo-stp_10.42.42.5(pid=31674): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31674)] 10:58:45.563145 run osmo-stp_10.42.42.5(pid=31674): stdout: | (launched: 2022-12-10_10:58:44.198761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:45.692763 run osmo-stp_10.42.42.5(pid=31674): stderr: | 20221210105844369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105844369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105844370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105844370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105844370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105844371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105844371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:45.822622 run osmo-stp_10.42.42.5(pid=31674): stdout: | (launched: 2022-12-10_10:58:44.198761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:45.971895 run osmo-stp_10.42.42.5(pid=31674): stderr: | 20221210105844369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105844369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105844370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105844370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105844370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105844371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105844371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:46.121805 run patchelf(pid=31677): Terminating (SIGINT) 10:58:46.295711 run patchelf(pid=31677): Terminated: ok {rc=0} 10:58:46.421576 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31674): Process ended prematurely: osmo-stp_10.42.42.5(pid=31674) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31674)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 10:58:46.431545 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 10:58:46.459986 run osmo-hlr_10.42.42.2(pid=31671): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31671)] 10:58:46.509244 run osmo-hlr_10.42.42.2(pid=31671): stdout: | (launched: 2022-12-10_10:58:43.259093) 10:58:46.559847 run osmo-hlr_10.42.42.2(pid=31671): stderr: | 20221210105843434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105843434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105843434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105843434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105843434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105843434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105843446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105843455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105843455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105843455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:46.610923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31664): Terminating (SIGTERM) 10:58:46.652724 run iperf3-srv_10.42.42.10(pid=31665): Terminating (SIGTERM) 10:58:46.696454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31666): Terminating (SIGTERM) 10:58:46.738218 run iperf3-srv_10.42.42.10(pid=31667): Terminating (SIGTERM) 10:58:46.782258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31670): Terminating (SIGTERM) 10:58:46.823481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31673): Terminating (SIGTERM) 10:58:46.864144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31676): Terminating (SIGTERM) 10:58:46.905621 --- ParallelTerminationStrategy: PID 31664 died... 10:58:46.925029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31664): Terminated: ok {rc=0} 10:58:46.970224 --- ParallelTerminationStrategy: PID 31665 died... 10:58:46.989407 run iperf3-srv_10.42.42.10(pid=31665): Terminated {rc=256} 10:58:47.034100 --- ParallelTerminationStrategy: PID 31666 died... 10:58:47.053531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31666): Terminated: ok {rc=0} 10:58:47.098542 --- ParallelTerminationStrategy: PID 31667 died... 10:58:47.117686 run iperf3-srv_10.42.42.10(pid=31667): Terminated {rc=256} 10:58:47.162563 --- ParallelTerminationStrategy: PID 31670 died... 10:58:47.181527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31670): Terminated: ok {rc=0} 10:58:47.226472 --- ParallelTerminationStrategy: PID 31673 died... 10:58:47.245598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31673): Terminated: ok {rc=0} 10:58:47.289679 --- ParallelTerminationStrategy: PID 31676 died... 10:58:47.308197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31676): Terminated: ok {rc=0} 10:58:47.392222 bus /gobi_0: Setting Powered False 10:58:48.490543 bus /gobi_0: Setting Powered False 10:58:49.608999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 10:58:50.756387 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:50.768036 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:58:50.819747 tst iperf3.py: using LAC 27922 10:58:50.938471 tst iperf3.py: using RAC 127 10:58:51.055736 tst iperf3.py: using CellId 27922 10:58:51.175563 tst iperf3.py: using BVCI 27923 10:58:51.295153 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.306572 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.317704 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.329153 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.340391 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.351816 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.363344 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.374648 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:58:51.386390 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:58:51.502501 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:58:51.721333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:58:52.045195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31678): Launched 10:58:52.327051 run iperf3-srv_10.42.42.10(pid=31679): Launched 10:58:52.448583 tst iperf3.py:8: start network... 10:58:52.667079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:58:53.166936 run create_hlr_db(pid=31680): Launched 10:58:53.290341 bus /gobi_6: Setting Powered False 10:58:54.354307 run create_hlr_db(pid=31680): Terminated: ok {rc=0} 10:58:54.802581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31682): Launched 10:58:55.125525 run osmo-hlr_10.42.42.2(pid=31683): Launched 10:58:55.250855 run osmo-stp_10.42.42.5: Starting osmo-stp 10:58:55.774253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31685): Launched 10:58:56.076401 run osmo-stp_10.42.42.5(pid=31686): Launched 10:58:56.191811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:58:56.715401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31688): Launched 10:58:56.832626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:58:57.089339 run patchelf(pid=31689): Launched 10:58:57.258514 run osmo-stp_10.42.42.5(pid=31686): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31686)] 10:58:57.387631 run osmo-stp_10.42.42.5(pid=31686): stdout: | (launched: 2022-12-10_10:58:56.021482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:57.518236 run osmo-stp_10.42.42.5(pid=31686): stderr: | 20221210105856191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105856192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105856192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105856192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105856193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105856193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105856193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:57.648095 run osmo-stp_10.42.42.5(pid=31686): stdout: | (launched: 2022-12-10_10:58:56.021482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:58:57.772312 run osmo-stp_10.42.42.5(pid=31686): stderr: | 20221210105856191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105856192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105856192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105856192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105856193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105856193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105856193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:58:57.919401 run patchelf(pid=31689): Terminating (SIGINT) 10:58:58.089504 run patchelf(pid=31689): Terminated: ok {rc=0} 10:58:58.212618 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31686): Process ended prematurely: osmo-stp_10.42.42.5(pid=31686) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31686)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 10:58:58.222165 tst iperf3.py:8: Test FAILED (7.5 sec) 10:58:58.249599 run osmo-hlr_10.42.42.2(pid=31683): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31683)] 10:58:58.297181 run osmo-hlr_10.42.42.2(pid=31683): stdout: | (launched: 2022-12-10_10:58:55.067212) 10:58:58.346425 run osmo-hlr_10.42.42.2(pid=31683): stderr: | 20221210105855265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105855265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105855265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105855265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105855265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105855265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105855280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105855288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105855288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105855288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:58:58.396174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31678): Terminating (SIGTERM) 10:58:58.436131 run iperf3-srv_10.42.42.10(pid=31679): Terminating (SIGTERM) 10:58:58.476187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31682): Terminating (SIGTERM) 10:58:58.515945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31685): Terminating (SIGTERM) 10:58:58.555729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31688): Terminating (SIGTERM) 10:58:58.597103 --- ParallelTerminationStrategy: PID 31678 died... 10:58:58.616555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31678): Terminated: ok {rc=0} 10:58:58.661724 --- ParallelTerminationStrategy: PID 31679 died... 10:58:58.680486 run iperf3-srv_10.42.42.10(pid=31679): Terminated {rc=256} 10:58:58.725308 --- ParallelTerminationStrategy: PID 31682 died... 10:58:58.744165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31682): Terminated: ok {rc=0} 10:58:58.788519 --- ParallelTerminationStrategy: PID 31685 died... 10:58:58.807358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31685): Terminated: ok {rc=0} 10:58:58.852044 --- ParallelTerminationStrategy: PID 31688 died... 10:58:58.870863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31688): Terminated: ok {rc=0} 10:58:58.957294 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 10:59:00.104939 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.116769 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:59:00.166616 tst iperf3m4.py: using LAC 27923 10:59:00.296352 tst iperf3m4.py: using RAC 128 10:59:00.423095 tst iperf3m4.py: using CellId 27923 10:59:00.550383 tst iperf3m4.py: using BVCI 27924 10:59:00.667831 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.679274 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.690567 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.702336 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.713960 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.726235 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.738108 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.749549 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:00.760902 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:59:00.880217 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:59:01.009864 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:59:01.129585 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:59:01.272001 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 10:59:01.509810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:59:01.838562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31692): Launched 10:59:02.131083 run iperf3-srv_10.42.42.10(pid=31693): Launched 10:59:02.268235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 10:59:02.471973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:59:02.777939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31694): Launched 10:59:03.042808 run iperf3-srv_10.42.42.10(pid=31695): Launched 10:59:03.156822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 10:59:03.359148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:59:03.662554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31696): Launched 10:59:03.926386 run iperf3-srv_10.42.42.10(pid=31697): Launched 10:59:04.040260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 10:59:04.243652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:59:04.547590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Launched 10:59:04.813607 run iperf3-srv_10.42.42.10(pid=31699): Launched 10:59:04.927414 tst iperf3m4.py:8: start network... 10:59:05.130407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:05.599123 run create_hlr_db(pid=31700): Launched 10:59:05.724879 bus /gobi_6: Setting Powered False 10:59:06.785911 run create_hlr_db(pid=31700): Terminated: ok {rc=0} 10:59:07.226681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31702): Launched 10:59:07.549602 run osmo-hlr_10.42.42.2(pid=31703): Launched 10:59:07.675013 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:08.238628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31705): Launched 10:59:08.561996 run osmo-stp_10.42.42.5(pid=31706): Launched 10:59:08.686836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:09.244655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31708): Launched 10:59:09.368269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:09.640644 run patchelf(pid=31709): Launched 10:59:09.819937 run osmo-stp_10.42.42.5(pid=31706): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31706)] 10:59:09.956497 run osmo-stp_10.42.42.5(pid=31706): stdout: | (launched: 2022-12-10_10:59:08.503386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:10.094909 run osmo-stp_10.42.42.5(pid=31706): stderr: | 20221210105908696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105908697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105908697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105908697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105908698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105908698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105908698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:10.234218 run osmo-stp_10.42.42.5(pid=31706): stdout: | (launched: 2022-12-10_10:59:08.503386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:10.366496 run osmo-stp_10.42.42.5(pid=31706): stderr: | 20221210105908696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105908697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105908697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105908697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105908698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105908698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105908698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:10.522503 run patchelf(pid=31709): Terminating (SIGINT) 10:59:10.703849 run patchelf(pid=31709): Terminated: ok {rc=0} 10:59:10.834537 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31706): Process ended prematurely: osmo-stp_10.42.42.5(pid=31706) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31706)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 10:59:10.844565 tst iperf3m4.py:8: Test FAILED (10.8 sec) 10:59:10.874514 run osmo-hlr_10.42.42.2(pid=31703): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31703)] 10:59:10.924665 run osmo-hlr_10.42.42.2(pid=31703): stdout: | (launched: 2022-12-10_10:59:07.491143) 10:59:10.976458 run osmo-hlr_10.42.42.2(pid=31703): stderr: | 20221210105907690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105907690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105907690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105907690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105907690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105907691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105907706 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105907714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105907714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105907714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:11.028862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31692): Terminating (SIGTERM) 10:59:11.070674 run iperf3-srv_10.42.42.10(pid=31693): Terminating (SIGTERM) 10:59:11.112684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31694): Terminating (SIGTERM) 10:59:11.155082 run iperf3-srv_10.42.42.10(pid=31695): Terminating (SIGTERM) 10:59:11.197299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31696): Terminating (SIGTERM) 10:59:11.239244 run iperf3-srv_10.42.42.10(pid=31697): Terminating (SIGTERM) 10:59:11.281010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Terminating (SIGTERM) 10:59:11.322935 run iperf3-srv_10.42.42.10(pid=31699): Terminating (SIGTERM) 10:59:11.364449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31702): Terminating (SIGTERM) 10:59:11.406285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31705): Terminating (SIGTERM) 10:59:11.447855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31708): Terminating (SIGTERM) 10:59:11.489819 --- ParallelTerminationStrategy: PID 31692 died... 10:59:11.509393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31692): Terminated: ok {rc=0} 10:59:11.555615 --- ParallelTerminationStrategy: PID 31693 died... 10:59:11.575160 run iperf3-srv_10.42.42.10(pid=31693): Terminated {rc=256} 10:59:11.621206 --- ParallelTerminationStrategy: PID 31694 died... 10:59:11.640484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31694): Terminated: ok {rc=0} 10:59:11.686506 --- ParallelTerminationStrategy: PID 31695 died... 10:59:11.705972 run iperf3-srv_10.42.42.10(pid=31695): Terminated {rc=256} 10:59:11.751967 --- ParallelTerminationStrategy: PID 31696 died... 10:59:11.771243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31696): Terminated: ok {rc=0} 10:59:11.817385 --- ParallelTerminationStrategy: PID 31697 died... 10:59:11.836513 run iperf3-srv_10.42.42.10(pid=31697): Terminated {rc=256} 10:59:11.882838 --- ParallelTerminationStrategy: PID 31698 died... 10:59:11.902225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Terminated: ok {rc=0} 10:59:11.948592 --- ParallelTerminationStrategy: PID 31699 died... 10:59:11.968158 run iperf3-srv_10.42.42.10(pid=31699): Terminated {rc=256} 10:59:12.014264 --- ParallelTerminationStrategy: PID 31702 died... 10:59:12.033675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31702): Terminated: ok {rc=0} 10:59:12.079898 --- ParallelTerminationStrategy: PID 31705 died... 10:59:12.099371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31705): Terminated: ok {rc=0} 10:59:12.145736 --- ParallelTerminationStrategy: PID 31708 died... 10:59:12.165243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31708): Terminated: ok {rc=0} 10:59:12.253181 bus /gobi_4: Setting Powered False 10:59:13.351828 bus /gobi_4: Setting Powered False 10:59:14.467667 bus /gobi_1: Setting Powered False 10:59:15.565086 bus /gobi_1: Setting Powered False 10:59:16.698819 bus /gobi_0: Setting Powered False 10:59:17.802819 bus /gobi_0: Setting Powered False 10:59:18.918508 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 10:59:20.020688 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.032674 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:59:20.083944 tst ping.py: using LAC 27924 10:59:20.210404 tst ping.py: using RAC 129 10:59:20.334687 tst ping.py: using CellId 27924 10:59:20.458668 tst ping.py: using BVCI 27925 10:59:20.574065 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.585576 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.596765 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.608252 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.619591 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.630962 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.642610 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:20.654070 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:59:20.767515 tst ping.py:19: start network... 10:59:20.966421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:21.426590 run create_hlr_db(pid=31710): Launched 10:59:21.548428 bus /gobi_6: Setting Powered False 10:59:22.608482 run create_hlr_db(pid=31710): Terminated: ok {rc=0} 10:59:23.041694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Launched 10:59:23.359345 run osmo-hlr_10.42.42.2(pid=31713): Launched 10:59:23.480706 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:24.032550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Launched 10:59:24.348585 run osmo-stp_10.42.42.5(pid=31716): Launched 10:59:24.469658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:25.018350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31718): Launched 10:59:25.141508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:25.411184 run patchelf(pid=31719): Launched 10:59:25.588758 run osmo-stp_10.42.42.5(pid=31716): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] 10:59:25.723645 run osmo-stp_10.42.42.5(pid=31716): stdout: | (launched: 2022-12-10_10:59:24.291060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:25.859984 run osmo-stp_10.42.42.5(pid=31716): stderr: | 20221210105924483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105924483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105924484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105924484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105924485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105924485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105924485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:25.996711 run osmo-stp_10.42.42.5(pid=31716): stdout: | (launched: 2022-12-10_10:59:24.291060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:26.127048 run osmo-stp_10.42.42.5(pid=31716): stderr: | 20221210105924483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105924483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105924484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105924484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105924485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105924485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105924485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:26.282229 run patchelf(pid=31719): Terminating (SIGINT) 10:59:26.461136 run patchelf(pid=31719): Terminated: ok {rc=0} 10:59:26.589978 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31716): Process ended prematurely: osmo-stp_10.42.42.5(pid=31716) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 10:59:26.599529 tst ping.py:22: Test FAILED (6.6 sec) 10:59:26.628364 run osmo-hlr_10.42.42.2(pid=31713): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31713)] 10:59:26.678383 run osmo-hlr_10.42.42.2(pid=31713): stdout: | (launched: 2022-12-10_10:59:23.301831) 10:59:26.730045 run osmo-hlr_10.42.42.2(pid=31713): stderr: | 20221210105923499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105923499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105923499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105923499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105923499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105923499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105923512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105923520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105923520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105923520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:26.782107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Terminating (SIGTERM) 10:59:26.824308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Terminating (SIGTERM) 10:59:26.866329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31718): Terminating (SIGTERM) 10:59:26.908294 --- ParallelTerminationStrategy: PID 31712 died... 10:59:26.928016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Terminated: ok {rc=0} 10:59:26.974752 --- ParallelTerminationStrategy: PID 31715 died... 10:59:26.994268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Terminated: ok {rc=0} 10:59:27.040542 --- ParallelTerminationStrategy: PID 31718 died... 10:59:27.059992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31718): Terminated: ok {rc=0} 10:59:27.147064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 10:59:28.234834 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.246685 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 10:59:28.297972 tst ping_idle_ping.py: using LAC 27925 10:59:28.416316 tst ping_idle_ping.py: using RAC 130 10:59:28.533372 tst ping_idle_ping.py: using CellId 27925 10:59:28.649807 tst ping_idle_ping.py: using BVCI 27926 10:59:28.759492 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.770574 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.781446 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.792369 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.803278 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.814637 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.825971 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 10:59:28.837146 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 10:59:28.950619 tst ping_idle_ping.py:24: start network... 10:59:29.151069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:29.614965 run create_hlr_db(pid=31720): Launched 10:59:29.735870 bus /gobi_6: Setting Powered False 10:59:30.795732 run create_hlr_db(pid=31720): Terminated: ok {rc=0} 10:59:31.248602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31722): Launched 10:59:31.575473 run osmo-hlr_10.42.42.2(pid=31723): Launched 10:59:31.721790 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:32.405654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31725): Launched 10:59:32.703629 run osmo-stp_10.42.42.5(pid=31726): Launched 10:59:32.816420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:33.329257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31728): Launched 10:59:33.443037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:33.693262 run patchelf(pid=31729): Launched 10:59:33.858549 run osmo-stp_10.42.42.5(pid=31726): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31726)] 10:59:33.983567 run osmo-stp_10.42.42.5(pid=31726): stdout: | (launched: 2022-12-10_10:59:32.649204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:34.110939 run osmo-stp_10.42.42.5(pid=31726): stderr: | 20221210105932818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105932819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105932819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105932819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105932820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105932820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105932820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:34.238378 run osmo-stp_10.42.42.5(pid=31726): stdout: | (launched: 2022-12-10_10:59:32.649204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:34.359617 run osmo-stp_10.42.42.5(pid=31726): stderr: | 20221210105932818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105932819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105932819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105932819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105932820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105932820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105932820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:34.503276 run patchelf(pid=31729): Terminating (SIGINT) 10:59:34.670540 run patchelf(pid=31729): Terminated: ok {rc=0} 10:59:34.791065 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31726): Process ended prematurely: osmo-stp_10.42.42.5(pid=31726) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31726)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 10:59:34.799889 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 10:59:34.827152 run osmo-hlr_10.42.42.2(pid=31723): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31723)] 10:59:34.875051 run osmo-hlr_10.42.42.2(pid=31723): stdout: | (launched: 2022-12-10_10:59:31.506913) 10:59:34.924251 run osmo-hlr_10.42.42.2(pid=31723): stderr: | 20221210105931882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105931882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105931882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105931882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105931882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105931882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105931900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105931926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105931926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105931926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:34.973449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31722): Terminating (SIGTERM) 10:59:35.013101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31725): Terminating (SIGTERM) 10:59:35.052707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31728): Terminating (SIGTERM) 10:59:35.092719 --- ParallelTerminationStrategy: PID 31722 died... 10:59:35.112008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31722): Terminated: ok {rc=0} 10:59:35.156387 --- ParallelTerminationStrategy: PID 31725 died... 10:59:35.175242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31725): Terminated: ok {rc=0} 10:59:35.219132 --- ParallelTerminationStrategy: PID 31728 died... 10:59:35.237913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31728): Terminated: ok {rc=0} 10:59:35.323360 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 10:59:36.634611 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 10:59:36.641783 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 10:59:36.673973 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 10:59:36.712294 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 10:59:36.798908 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 10:59:36.830761 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 10:59:36.868614 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 10:59:37.464143 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 10:59:37.512605 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:37.523605 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:59:37.590121 tst cs_paging_gprs_active.py: using LAC 27926 10:59:37.709619 tst cs_paging_gprs_active.py: using RAC 131 10:59:37.829776 tst cs_paging_gprs_active.py: using CellId 27926 10:59:37.949462 tst cs_paging_gprs_active.py: using BVCI 27927 10:59:38.069071 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.080735 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.092230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.104474 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.117649 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.129744 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.141043 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.152898 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:38.166347 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:59:38.286246 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:59:38.403864 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 10:59:38.606662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:59:38.909134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31733): Launched 10:59:39.171744 run iperf3-srv_10.42.42.10(pid=31734): Launched 10:59:39.285177 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 10:59:39.486929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:59:39.788685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31735): Launched 10:59:40.051615 run iperf3-srv_10.42.42.10(pid=31736): Launched 10:59:40.164648 tst cs_paging_gprs_active.py:38: start network... 10:59:40.366513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:40.834887 run create_hlr_db(pid=31737): Launched 10:59:40.960011 bus /gobi_6: Setting Powered False 10:59:42.020931 run create_hlr_db(pid=31737): Terminated: ok {rc=0} 10:59:42.462870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31739): Launched 10:59:42.786557 run osmo-hlr_10.42.42.2(pid=31740): Launched 10:59:42.911055 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:43.471770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31742): Launched 10:59:43.775276 run osmo-stp_10.42.42.5(pid=31743): Launched 10:59:43.891211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:44.414976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31745): Launched 10:59:44.530712 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:44.785805 run patchelf(pid=31746): Launched 10:59:44.956391 run osmo-stp_10.42.42.5(pid=31743): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31743)] 10:59:45.085969 run osmo-stp_10.42.42.5(pid=31743): stdout: | (launched: 2022-12-10_10:59:43.720120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:45.216205 run osmo-stp_10.42.42.5(pid=31743): stderr: | 20221210105943892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105943892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105943893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105943893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105943893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105943894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105943894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:45.346742 run osmo-stp_10.42.42.5(pid=31743): stdout: | (launched: 2022-12-10_10:59:43.720120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:45.470768 run osmo-stp_10.42.42.5(pid=31743): stderr: | 20221210105943892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105943892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105943893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105943893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105943893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105943894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105943894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:45.618668 run patchelf(pid=31746): Terminating (SIGINT) 10:59:45.790023 run patchelf(pid=31746): Terminated: ok {rc=0} 10:59:45.918218 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31743): Process ended prematurely: osmo-stp_10.42.42.5(pid=31743) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31743)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 10:59:45.928194 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 10:59:45.956048 run osmo-hlr_10.42.42.2(pid=31740): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31740)] 10:59:46.004620 run osmo-hlr_10.42.42.2(pid=31740): stdout: | (launched: 2022-12-10_10:59:42.728306) 10:59:46.054696 run osmo-hlr_10.42.42.2(pid=31740): stderr: | 20221210105942929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105942929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105942929 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105942930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105942930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105942930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105942946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105942955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105942955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105942955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:46.105539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31733): Terminating (SIGTERM) 10:59:46.145892 run iperf3-srv_10.42.42.10(pid=31734): Terminating (SIGTERM) 10:59:46.186252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31735): Terminating (SIGTERM) 10:59:46.226689 run iperf3-srv_10.42.42.10(pid=31736): Terminating (SIGTERM) 10:59:46.268437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31739): Terminating (SIGTERM) 10:59:46.309935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31742): Terminating (SIGTERM) 10:59:46.351873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31745): Terminating (SIGTERM) 10:59:46.393265 --- ParallelTerminationStrategy: PID 31733 died... 10:59:46.412803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31733): Terminated: ok {rc=0} 10:59:46.458076 --- ParallelTerminationStrategy: PID 31734 died... 10:59:46.477384 run iperf3-srv_10.42.42.10(pid=31734): Terminated {rc=256} 10:59:46.522623 --- ParallelTerminationStrategy: PID 31735 died... 10:59:46.541948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31735): Terminated: ok {rc=0} 10:59:46.586918 --- ParallelTerminationStrategy: PID 31736 died... 10:59:46.606268 run iperf3-srv_10.42.42.10(pid=31736): Terminated {rc=256} 10:59:46.651432 --- ParallelTerminationStrategy: PID 31739 died... 10:59:46.670724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31739): Terminated: ok {rc=0} 10:59:46.715928 --- ParallelTerminationStrategy: PID 31742 died... 10:59:46.735190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31742): Terminated: ok {rc=0} 10:59:46.779591 --- ParallelTerminationStrategy: PID 31745 died... 10:59:46.798909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31745): Terminated: ok {rc=0} 10:59:46.883723 bus /gobi_0: Setting Powered False 10:59:47.980129 bus /gobi_0: Setting Powered False 10:59:49.096593 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 10:59:50.238092 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.249686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:59:50.319333 tst iperf3.py: using LAC 27927 10:59:50.436729 tst iperf3.py: using RAC 132 10:59:50.554551 tst iperf3.py: using CellId 27927 10:59:50.672027 tst iperf3.py: using BVCI 27928 10:59:50.782487 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.793439 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.804118 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.814897 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.825750 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.836362 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.847133 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.857887 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:50.868573 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 10:59:50.983577 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 10:59:51.185801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 10:59:51.488399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31747): Launched 10:59:51.751597 run iperf3-srv_10.42.42.10(pid=31748): Launched 10:59:51.864621 tst iperf3.py:8: start network... 10:59:52.067252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 10:59:52.534314 run create_hlr_db(pid=31749): Launched 10:59:52.656693 bus /gobi_6: Setting Powered False 10:59:53.717073 run create_hlr_db(pid=31749): Terminated: ok {rc=0} 10:59:54.157369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31751): Launched 10:59:54.482455 run osmo-hlr_10.42.42.2(pid=31752): Launched 10:59:54.606541 run osmo-stp_10.42.42.5: Starting osmo-stp 10:59:55.167231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31754): Launched 10:59:55.489829 run osmo-stp_10.42.42.5(pid=31755): Launched 10:59:55.613909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 10:59:56.169917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31757): Launched 10:59:56.294421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 10:59:56.566772 run patchelf(pid=31758): Launched 10:59:56.746848 run osmo-stp_10.42.42.5(pid=31755): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31755)] 10:59:56.884068 run osmo-stp_10.42.42.5(pid=31755): stdout: | (launched: 2022-12-10_10:59:55.431512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:57.023180 run osmo-stp_10.42.42.5(pid=31755): stderr: | 20221210105955621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105955621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105955621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105955622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105955624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105955624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105955624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:57.162686 run osmo-stp_10.42.42.5(pid=31755): stdout: | (launched: 2022-12-10_10:59:55.431512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 10:59:57.295862 run osmo-stp_10.42.42.5(pid=31755): stderr: | 20221210105955621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210105955621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210105955621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210105955622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210105955624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210105955624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210105955624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 10:59:57.453790 run patchelf(pid=31758): Terminating (SIGINT) 10:59:57.635878 run patchelf(pid=31758): Terminated: ok {rc=0} 10:59:57.767495 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31755): Process ended prematurely: osmo-stp_10.42.42.5(pid=31755) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31755)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 10:59:57.777671 tst iperf3.py:8: Test FAILED (7.6 sec) 10:59:57.806768 run osmo-hlr_10.42.42.2(pid=31752): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31752)] 10:59:57.857057 run osmo-hlr_10.42.42.2(pid=31752): stdout: | (launched: 2022-12-10_10:59:54.424061) 10:59:57.908853 run osmo-hlr_10.42.42.2(pid=31752): stderr: | 20221210105954622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210105954622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210105954622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210105954622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210105954622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210105954622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210105954634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210105954642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210105954642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210105954642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 10:59:57.961499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31747): Terminating (SIGTERM) 10:59:58.003263 run iperf3-srv_10.42.42.10(pid=31748): Terminating (SIGTERM) 10:59:58.046491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31751): Terminating (SIGTERM) 10:59:58.088599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31754): Terminating (SIGTERM) 10:59:58.130470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31757): Terminating (SIGTERM) 10:59:58.172405 --- ParallelTerminationStrategy: PID 31747 died... 10:59:58.192609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31747): Terminated: ok {rc=0} 10:59:58.239478 --- ParallelTerminationStrategy: PID 31748 died... 10:59:58.258993 run iperf3-srv_10.42.42.10(pid=31748): Terminated {rc=256} 10:59:58.305517 --- ParallelTerminationStrategy: PID 31751 died... 10:59:58.324795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31751): Terminated: ok {rc=0} 10:59:58.371153 --- ParallelTerminationStrategy: PID 31754 died... 10:59:58.390811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31754): Terminated: ok {rc=0} 10:59:58.437232 --- ParallelTerminationStrategy: PID 31757 died... 10:59:58.456685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31757): Terminated: ok {rc=0} 10:59:58.546185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 10:59:59.697561 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 10:59:59.709591 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 10:59:59.781399 tst iperf3m4.py: using LAC 27928 10:59:59.907138 tst iperf3m4.py: using RAC 133 11:00:00.026490 tst iperf3m4.py: using CellId 27928 11:00:00.143969 tst iperf3m4.py: using BVCI 27929 11:00:00.253779 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.264889 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.276015 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.287177 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.298219 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.309196 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.320331 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.331204 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:00.342391 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:00:00.460531 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:00:00.578454 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:00:00.698710 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:00:00.816577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:00:01.045464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:01.385423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31759): Launched 11:00:01.691284 run iperf3-srv_10.42.42.10(pid=31762): Launched 11:00:01.824559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:00:02.063029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:02.406493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31765): Launched 11:00:02.718843 run iperf3-srv_10.42.42.10(pid=31772): Launched 11:00:02.848062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:00:03.065896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:03.391350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31773): Launched 11:00:03.674398 run iperf3-srv_10.42.42.10(pid=31774): Launched 11:00:03.795799 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:00:04.013795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:04.339748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31775): Launched 11:00:04.621101 run iperf3-srv_10.42.42.10(pid=31776): Launched 11:00:04.742623 tst iperf3m4.py:8: start network... 11:00:04.960907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:05.463253 run create_hlr_db(pid=31777): Launched 11:00:05.586253 bus /gobi_6: Setting Powered False 11:00:06.650489 run create_hlr_db(pid=31777): Terminated: ok {rc=0} 11:00:07.100077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31779): Launched 11:00:07.423733 run osmo-hlr_10.42.42.2(pid=31780): Launched 11:00:07.547817 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:08.110955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31782): Launched 11:00:08.436643 run osmo-stp_10.42.42.5(pid=31783): Launched 11:00:08.560669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:09.118275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31785): Launched 11:00:09.243445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:09.516767 run patchelf(pid=31786): Launched 11:00:09.697094 run osmo-stp_10.42.42.5(pid=31783): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31783)] 11:00:09.833525 run osmo-stp_10.42.42.5(pid=31783): stdout: | (launched: 2022-12-10_11:00:08.377898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:09.971804 run osmo-stp_10.42.42.5(pid=31783): stderr: | 20221210110008568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110008568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110008568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110008569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110008571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110008571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110008571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:10.110287 run osmo-stp_10.42.42.5(pid=31783): stdout: | (launched: 2022-12-10_11:00:08.377898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:10.242704 run osmo-stp_10.42.42.5(pid=31783): stderr: | 20221210110008568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110008568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110008568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110008569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110008571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110008571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110008571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:10.399338 run patchelf(pid=31786): Terminating (SIGINT) 11:00:10.580758 run patchelf(pid=31786): Terminated: ok {rc=0} 11:00:10.711946 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31783): Process ended prematurely: osmo-stp_10.42.42.5(pid=31783) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31783)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:00:10.722228 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:00:10.751529 run osmo-hlr_10.42.42.2(pid=31780): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31780)] 11:00:10.801642 run osmo-hlr_10.42.42.2(pid=31780): stdout: | (launched: 2022-12-10_11:00:07.365309) 11:00:10.853561 run osmo-hlr_10.42.42.2(pid=31780): stderr: | 20221210110007564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110007564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110007564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110007564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110007564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110007564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110007580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110007590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110007590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110007590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:10.905901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31759): Terminating (SIGTERM) 11:00:10.948077 run iperf3-srv_10.42.42.10(pid=31762): Terminating (SIGTERM) 11:00:10.990279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31765): Terminating (SIGTERM) 11:00:11.032440 run iperf3-srv_10.42.42.10(pid=31772): Terminating (SIGTERM) 11:00:11.074492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31773): Terminating (SIGTERM) 11:00:11.116594 run iperf3-srv_10.42.42.10(pid=31774): Terminating (SIGTERM) 11:00:11.158926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31775): Terminating (SIGTERM) 11:00:11.201562 run iperf3-srv_10.42.42.10(pid=31776): Terminating (SIGTERM) 11:00:11.243360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31779): Terminating (SIGTERM) 11:00:11.285300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31782): Terminating (SIGTERM) 11:00:11.327334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31785): Terminating (SIGTERM) 11:00:11.369794 --- ParallelTerminationStrategy: PID 31759 died... 11:00:11.389812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31759): Terminated: ok {rc=0} 11:00:11.436681 --- ParallelTerminationStrategy: PID 31762 died... 11:00:11.456329 run iperf3-srv_10.42.42.10(pid=31762): Terminated {rc=256} 11:00:11.502657 --- ParallelTerminationStrategy: PID 31765 died... 11:00:11.522251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31765): Terminated: ok {rc=0} 11:00:11.569119 --- ParallelTerminationStrategy: PID 31772 died... 11:00:11.588701 run iperf3-srv_10.42.42.10(pid=31772): Terminated {rc=256} 11:00:11.635096 --- ParallelTerminationStrategy: PID 31773 died... 11:00:11.654660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31773): Terminated: ok {rc=0} 11:00:11.701507 --- ParallelTerminationStrategy: PID 31774 died... 11:00:11.721260 run iperf3-srv_10.42.42.10(pid=31774): Terminated {rc=256} 11:00:11.767511 --- ParallelTerminationStrategy: PID 31775 died... 11:00:11.787171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31775): Terminated: ok {rc=0} 11:00:11.834069 --- ParallelTerminationStrategy: PID 31776 died... 11:00:11.853685 run iperf3-srv_10.42.42.10(pid=31776): Terminated {rc=256} 11:00:11.899962 --- ParallelTerminationStrategy: PID 31779 died... 11:00:11.919404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31779): Terminated: ok {rc=0} 11:00:11.965681 --- ParallelTerminationStrategy: PID 31782 died... 11:00:11.985337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31782): Terminated: ok {rc=0} 11:00:12.031938 --- ParallelTerminationStrategy: PID 31785 died... 11:00:12.051607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31785): Terminated: ok {rc=0} 11:00:12.141361 bus /gobi_4: Setting Powered False 11:00:13.245129 bus /gobi_4: Setting Powered False 11:00:14.370648 bus /gobi_1: Setting Powered False 11:00:15.471771 bus /gobi_1: Setting Powered False 11:00:16.590030 bus /gobi_0: Setting Powered False 11:00:17.689941 bus /gobi_0: Setting Powered False 11:00:18.806518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:00:19.912082 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:19.924130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:00:19.993939 tst ping.py: using LAC 27929 11:00:20.120583 tst ping.py: using RAC 134 11:00:20.245378 tst ping.py: using CellId 27929 11:00:20.371250 tst ping.py: using BVCI 27930 11:00:20.486891 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:20.498497 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:20.509742 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:20.521246 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:20.532745 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:20.544398 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:20.555983 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:20.567417 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:00:20.685686 tst ping.py:19: start network... 11:00:20.899978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:21.393143 run create_hlr_db(pid=32138): Launched 11:00:21.514055 bus /gobi_6: Setting Powered False 11:00:22.577825 run create_hlr_db(pid=32138): Terminated: ok {rc=0} 11:00:23.004599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32140): Launched 11:00:23.304401 run osmo-hlr_10.42.42.2(pid=32141): Launched 11:00:23.495088 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:24.105780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Launched 11:00:24.421742 run osmo-stp_10.42.42.5(pid=32318): Launched 11:00:24.574941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:25.276221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32321): Launched 11:00:25.411820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:25.695241 run patchelf(pid=32322): Launched 11:00:25.891304 run osmo-stp_10.42.42.5(pid=32318): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32318)] 11:00:26.030644 run osmo-stp_10.42.42.5(pid=32318): stdout: | (launched: 2022-12-10_11:00:24.361697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:26.173854 run osmo-stp_10.42.42.5(pid=32318): stderr: | 20221210110024712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110024712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110024712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110024713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110024713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110024713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110024713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:26.316495 run osmo-stp_10.42.42.5(pid=32318): stdout: | (launched: 2022-12-10_11:00:24.361697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:26.450755 run osmo-stp_10.42.42.5(pid=32318): stderr: | 20221210110024712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110024712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110024712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110024713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110024713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110024713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110024713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:26.610915 run patchelf(pid=32322): Terminating (SIGINT) 11:00:26.795449 run patchelf(pid=32322): Terminated: ok {rc=0} 11:00:26.929003 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32318): Process ended prematurely: osmo-stp_10.42.42.5(pid=32318) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32318)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 11:00:26.939691 tst ping.py:22: Test FAILED (7.0 sec) 11:00:26.971896 run osmo-hlr_10.42.42.2(pid=32141): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32141)] 11:00:27.024712 run osmo-hlr_10.42.42.2(pid=32141): stdout: | (launched: 2022-12-10_11:00:23.250077) 11:00:27.081463 run osmo-hlr_10.42.42.2(pid=32141): stderr: | 20221210110023518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110023518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110023518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110023518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110023518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110023518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110023543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110023573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110023574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110023574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:27.136415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32140): Terminating (SIGTERM) 11:00:27.181397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Terminating (SIGTERM) 11:00:27.227870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32321): Terminating (SIGTERM) 11:00:27.274398 --- ParallelTerminationStrategy: PID 32140 died... 11:00:27.295959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32140): Terminated: ok {rc=0} 11:00:27.347427 --- ParallelTerminationStrategy: PID 32243 died... 11:00:27.368251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Terminated: ok {rc=0} 11:00:27.418127 --- ParallelTerminationStrategy: PID 32321 died... 11:00:27.438977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32321): Terminated: ok {rc=0} 11:00:27.534518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:00:28.626350 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:28.638434 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:00:28.706552 tst ping_idle_ping.py: using LAC 27930 11:00:28.829437 tst ping_idle_ping.py: using RAC 135 11:00:28.949584 tst ping_idle_ping.py: using CellId 27930 11:00:29.075281 tst ping_idle_ping.py: using BVCI 27931 11:00:29.204788 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:29.216426 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:29.227971 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:29.239491 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:29.250937 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:29.263149 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:29.274637 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:00:29.285757 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:00:29.400637 tst ping_idle_ping.py:24: start network... 11:00:29.601800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:30.066243 run create_hlr_db(pid=32324): Launched 11:00:30.188618 bus /gobi_6: Setting Powered False 11:00:31.251221 run create_hlr_db(pid=32324): Terminated: ok {rc=0} 11:00:31.709896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32326): Launched 11:00:32.050501 run osmo-hlr_10.42.42.2(pid=32327): Launched 11:00:32.187927 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:32.745902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32329): Launched 11:00:33.064183 run osmo-stp_10.42.42.5(pid=32330): Launched 11:00:33.186729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:33.738621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32332): Launched 11:00:33.862117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:34.131940 run patchelf(pid=32333): Launched 11:00:34.310715 run osmo-stp_10.42.42.5(pid=32330): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32330)] 11:00:34.445996 run osmo-stp_10.42.42.5(pid=32330): stdout: | (launched: 2022-12-10_11:00:33.006493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:34.583156 run osmo-stp_10.42.42.5(pid=32330): stderr: | 20221210110033201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110033201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110033201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110033202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110033204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110033204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110033204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:34.720045 run osmo-stp_10.42.42.5(pid=32330): stdout: | (launched: 2022-12-10_11:00:33.006493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:34.851034 run osmo-stp_10.42.42.5(pid=32330): stderr: | 20221210110033201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110033201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110033201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110033202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110033204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110033204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110033204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:35.005924 run patchelf(pid=32333): Terminating (SIGINT) 11:00:35.185412 run patchelf(pid=32333): Terminated: ok {rc=0} 11:00:35.315341 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32330): Process ended prematurely: osmo-stp_10.42.42.5(pid=32330) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32330)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:00:35.324862 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:00:35.353601 run osmo-hlr_10.42.42.2(pid=32327): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32327)] 11:00:35.404312 run osmo-hlr_10.42.42.2(pid=32327): stdout: | (launched: 2022-12-10_11:00:31.988415) 11:00:35.456272 run osmo-hlr_10.42.42.2(pid=32327): stderr: | 20221210110032252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110032252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110032252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110032252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110032252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110032252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110032265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110032274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110032274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110032274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:35.508795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32326): Terminating (SIGTERM) 11:00:35.550904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32329): Terminating (SIGTERM) 11:00:35.593323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32332): Terminating (SIGTERM) 11:00:35.635893 --- ParallelTerminationStrategy: PID 32326 died... 11:00:35.656093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32326): Terminated: ok {rc=0} 11:00:35.702830 --- ParallelTerminationStrategy: PID 32329 died... 11:00:35.722465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32329): Terminated: ok {rc=0} 11:00:35.769279 --- ParallelTerminationStrategy: PID 32332 died... 11:00:35.788730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32332): Terminated: ok {rc=0} 11:00:35.877975 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:00:37.191632 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:00:37.198911 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:00:37.232556 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:00:37.271389 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:00:37.356811 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:00:37.389131 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:00:37.427473 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:00:38.029243 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:00:38.078736 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.090121 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:00:38.139024 tst cs_paging_gprs_active.py: using LAC 27931 11:00:38.257614 tst cs_paging_gprs_active.py: using RAC 136 11:00:38.373913 tst cs_paging_gprs_active.py: using CellId 27931 11:00:38.490141 tst cs_paging_gprs_active.py: using BVCI 27932 11:00:38.599951 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.611272 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.622470 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.633693 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.644728 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.655802 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.667070 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.678152 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:38.689509 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:00:38.807601 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:00:38.923793 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:00:39.126301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:39.428422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Launched 11:00:39.689651 run iperf3-srv_10.42.42.10(pid=32339): Launched 11:00:39.802982 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:00:40.005732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:40.308358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Launched 11:00:40.570212 run iperf3-srv_10.42.42.10(pid=32341): Launched 11:00:40.682827 tst cs_paging_gprs_active.py:38: start network... 11:00:40.883334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:41.350163 run create_hlr_db(pid=32342): Launched 11:00:41.473566 bus /gobi_6: Setting Powered False 11:00:42.534248 run create_hlr_db(pid=32342): Terminated: ok {rc=0} 11:00:42.972803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32344): Launched 11:00:43.292493 run osmo-hlr_10.42.42.2(pid=32345): Launched 11:00:43.415227 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:43.969491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32347): Launched 11:00:44.290331 run osmo-stp_10.42.42.5(pid=32348): Launched 11:00:44.413021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:44.967965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32350): Launched 11:00:45.091189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:45.363581 run patchelf(pid=32351): Launched 11:00:45.542963 run osmo-stp_10.42.42.5(pid=32348): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32348)] 11:00:45.678885 run osmo-stp_10.42.42.5(pid=32348): stdout: | (launched: 2022-12-10_11:00:44.232563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:45.816164 run osmo-stp_10.42.42.5(pid=32348): stderr: | 20221210110044424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110044424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110044424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110044425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110044425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110044425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110044425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:45.962594 run osmo-stp_10.42.42.5(pid=32348): stdout: | (launched: 2022-12-10_11:00:44.232563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:46.097531 run osmo-stp_10.42.42.5(pid=32348): stderr: | 20221210110044424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110044424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110044424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110044425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110044425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110044425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110044425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:46.257353 run patchelf(pid=32351): Terminating (SIGINT) 11:00:46.442026 run patchelf(pid=32351): Terminated: ok {rc=0} 11:00:46.575315 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32348): Process ended prematurely: osmo-stp_10.42.42.5(pid=32348) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32348)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:00:46.586618 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:00:46.618277 run osmo-hlr_10.42.42.2(pid=32345): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32345)] 11:00:46.670958 run osmo-hlr_10.42.42.2(pid=32345): stdout: | (launched: 2022-12-10_11:00:43.234962) 11:00:46.725271 run osmo-hlr_10.42.42.2(pid=32345): stderr: | 20221210110043430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110043430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110043430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110043430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110043430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110043430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110043443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110043453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110043454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110043454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:46.780096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminating (SIGTERM) 11:00:46.824778 run iperf3-srv_10.42.42.10(pid=32339): Terminating (SIGTERM) 11:00:46.871868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Terminating (SIGTERM) 11:00:46.916586 run iperf3-srv_10.42.42.10(pid=32341): Terminating (SIGTERM) 11:00:46.963455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32344): Terminating (SIGTERM) 11:00:47.007854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32347): Terminating (SIGTERM) 11:00:47.051919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32350): Terminating (SIGTERM) 11:00:47.095904 --- ParallelTerminationStrategy: PID 32338 died... 11:00:47.116235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminated: ok {rc=0} 11:00:47.165150 --- ParallelTerminationStrategy: PID 32339 died... 11:00:47.185433 run iperf3-srv_10.42.42.10(pid=32339): Terminated {rc=256} 11:00:47.234577 --- ParallelTerminationStrategy: PID 32340 died... 11:00:47.253998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Terminated: ok {rc=0} 11:00:47.301401 --- ParallelTerminationStrategy: PID 32341 died... 11:00:47.320693 run iperf3-srv_10.42.42.10(pid=32341): Terminated {rc=256} 11:00:47.368024 --- ParallelTerminationStrategy: PID 32344 died... 11:00:47.387565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32344): Terminated: ok {rc=0} 11:00:47.434664 --- ParallelTerminationStrategy: PID 32347 died... 11:00:47.454224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32347): Terminated: ok {rc=0} 11:00:47.501600 --- ParallelTerminationStrategy: PID 32350 died... 11:00:47.521271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32350): Terminated: ok {rc=0} 11:00:47.610418 bus /gobi_0: Setting Powered False 11:00:48.709773 bus /gobi_0: Setting Powered False 11:00:49.829064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:00:50.975510 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:50.987470 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:00:51.037328 tst iperf3.py: using LAC 27932 11:00:51.167428 tst iperf3.py: using RAC 137 11:00:51.293577 tst iperf3.py: using CellId 27932 11:00:51.416923 tst iperf3.py: using BVCI 27933 11:00:51.534108 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.546112 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.557910 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.569843 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.582042 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.594052 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.606113 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.617807 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:00:51.629760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:00:51.751745 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:00:51.967531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:00:52.288258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32352): Launched 11:00:52.566430 run iperf3-srv_10.42.42.10(pid=32353): Launched 11:00:52.686432 tst iperf3.py:8: start network... 11:00:52.901897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:00:53.397245 run create_hlr_db(pid=32354): Launched 11:00:53.519291 bus /gobi_6: Setting Powered False 11:00:54.582708 run create_hlr_db(pid=32354): Terminated: ok {rc=0} 11:00:55.010703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32356): Launched 11:00:55.311689 run osmo-hlr_10.42.42.2(pid=32357): Launched 11:00:55.427478 run osmo-stp_10.42.42.5: Starting osmo-stp 11:00:55.944154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32359): Launched 11:00:56.243900 run osmo-stp_10.42.42.5(pid=32360): Launched 11:00:56.358656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:00:56.875570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32362): Launched 11:00:56.990973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:00:57.243380 run patchelf(pid=32363): Launched 11:00:57.410541 run osmo-stp_10.42.42.5(pid=32360): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32360)] 11:00:57.538749 run osmo-stp_10.42.42.5(pid=32360): stdout: | (launched: 2022-12-10_11:00:56.189278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:57.667585 run osmo-stp_10.42.42.5(pid=32360): stderr: | 20221210110056357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110056358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110056358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110056358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110056360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110056361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110056361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:57.796790 run osmo-stp_10.42.42.5(pid=32360): stdout: | (launched: 2022-12-10_11:00:56.189278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:00:57.919789 run osmo-stp_10.42.42.5(pid=32360): stderr: | 20221210110056357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110056358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110056358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110056358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110056360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110056361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110056361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:00:58.065790 run patchelf(pid=32363): Terminating (SIGINT) 11:00:58.234446 run patchelf(pid=32363): Terminated: ok {rc=0} 11:00:58.356177 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32360): Process ended prematurely: osmo-stp_10.42.42.5(pid=32360) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32360)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:00:58.365610 tst iperf3.py:8: Test FAILED (7.4 sec) 11:00:58.392542 run osmo-hlr_10.42.42.2(pid=32357): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32357)] 11:00:58.440075 run osmo-hlr_10.42.42.2(pid=32357): stdout: | (launched: 2022-12-10_11:00:55.257535) 11:00:58.489436 run osmo-hlr_10.42.42.2(pid=32357): stderr: | 20221210110055434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110055434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110055434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110055434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110055435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110055435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110055446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110055455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110055455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110055455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:00:58.539294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32352): Terminating (SIGTERM) 11:00:58.588303 run iperf3-srv_10.42.42.10(pid=32353): Terminating (SIGTERM) 11:00:58.633401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32356): Terminating (SIGTERM) 11:00:58.672810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32359): Terminating (SIGTERM) 11:00:58.712136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32362): Terminating (SIGTERM) 11:00:58.751827 --- ParallelTerminationStrategy: PID 32352 died... 11:00:58.770775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32352): Terminated: ok {rc=0} 11:00:58.814768 --- ParallelTerminationStrategy: PID 32353 died... 11:00:58.833192 run iperf3-srv_10.42.42.10(pid=32353): Terminated {rc=256} 11:00:58.876472 --- ParallelTerminationStrategy: PID 32356 died... 11:00:58.894900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32356): Terminated: ok {rc=0} 11:00:58.938475 --- ParallelTerminationStrategy: PID 32359 died... 11:00:58.956756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32359): Terminated: ok {rc=0} 11:00:59.000464 --- ParallelTerminationStrategy: PID 32362 died... 11:00:59.018864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32362): Terminated: ok {rc=0} 11:00:59.103721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:01:00.249805 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.261828 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:01:00.317889 tst iperf3m4.py: using LAC 27933 11:01:00.443030 tst iperf3m4.py: using RAC 138 11:01:00.570244 tst iperf3m4.py: using CellId 27933 11:01:00.696039 tst iperf3m4.py: using BVCI 27934 11:01:00.812316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.824254 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.836557 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.849456 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.862029 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.875301 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.888415 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.904008 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:00.918309 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:01:01.051236 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:01:01.185972 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:01:01.305904 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:01:01.450360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:01:01.659412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:01.985733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32364): Launched 11:01:02.269789 run iperf3-srv_10.42.42.10(pid=32365): Launched 11:01:02.394609 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:01:02.611537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:02.934005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32366): Launched 11:01:03.212376 run iperf3-srv_10.42.42.10(pid=32367): Launched 11:01:03.333628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:01:03.549273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:03.871958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32368): Launched 11:01:04.150903 run iperf3-srv_10.42.42.10(pid=32369): Launched 11:01:04.271614 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:01:04.487667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:01:04.808597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32370): Launched 11:01:05.085645 run iperf3-srv_10.42.42.10(pid=32371): Launched 11:01:05.206273 tst iperf3m4.py:8: start network... 11:01:05.422351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:05.918508 run create_hlr_db(pid=32372): Launched 11:01:06.039937 bus /gobi_6: Setting Powered False 11:01:07.104082 run create_hlr_db(pid=32372): Terminated: ok {rc=0} 11:01:07.531530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32374): Launched 11:01:07.831701 run osmo-hlr_10.42.42.2(pid=32375): Launched 11:01:07.946509 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:08.462150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32377): Launched 11:01:08.761682 run osmo-stp_10.42.42.5(pid=32378): Launched 11:01:08.877537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:09.397205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32380): Launched 11:01:09.512113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:09.765048 run patchelf(pid=32381): Launched 11:01:09.932049 run osmo-stp_10.42.42.5(pid=32378): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32378)] 11:01:10.059652 run osmo-stp_10.42.42.5(pid=32378): stdout: | (launched: 2022-12-10_11:01:08.707321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:10.188679 run osmo-stp_10.42.42.5(pid=32378): stderr: | 20221210110108879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110108879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110108879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110108879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110108880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110108880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110108880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:10.317885 run osmo-stp_10.42.42.5(pid=32378): stdout: | (launched: 2022-12-10_11:01:08.707321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:10.440572 run osmo-stp_10.42.42.5(pid=32378): stderr: | 20221210110108879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110108879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110108879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110108879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110108880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110108880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110108880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:10.586212 run patchelf(pid=32381): Terminating (SIGINT) 11:01:10.755239 run patchelf(pid=32381): Terminated: ok {rc=0} 11:01:10.877275 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32378): Process ended prematurely: osmo-stp_10.42.42.5(pid=32378) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32378)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:01:10.886697 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:01:10.913919 run osmo-hlr_10.42.42.2(pid=32375): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32375)] 11:01:10.960938 run osmo-hlr_10.42.42.2(pid=32375): stdout: | (launched: 2022-12-10_11:01:07.777083) 11:01:11.009664 run osmo-hlr_10.42.42.2(pid=32375): stderr: | 20221210110107955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110107955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110107955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110107955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110107955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110107956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110107968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110107979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110107979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110107979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:11.058770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32364): Terminating (SIGTERM) 11:01:11.098154 run iperf3-srv_10.42.42.10(pid=32365): Terminating (SIGTERM) 11:01:11.137461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32366): Terminating (SIGTERM) 11:01:11.176804 run iperf3-srv_10.42.42.10(pid=32367): Terminating (SIGTERM) 11:01:11.215886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32368): Terminating (SIGTERM) 11:01:11.255325 run iperf3-srv_10.42.42.10(pid=32369): Terminating (SIGTERM) 11:01:11.294561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32370): Terminating (SIGTERM) 11:01:11.333918 run iperf3-srv_10.42.42.10(pid=32371): Terminating (SIGTERM) 11:01:11.373111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32374): Terminating (SIGTERM) 11:01:11.412365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32377): Terminating (SIGTERM) 11:01:11.451635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32380): Terminating (SIGTERM) 11:01:11.491070 --- ParallelTerminationStrategy: PID 32364 died... 11:01:11.509943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32364): Terminated: ok {rc=0} 11:01:11.553741 --- ParallelTerminationStrategy: PID 32365 died... 11:01:11.572068 run iperf3-srv_10.42.42.10(pid=32365): Terminated {rc=256} 11:01:11.615257 --- ParallelTerminationStrategy: PID 32366 died... 11:01:11.634081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32366): Terminated: ok {rc=0} 11:01:11.677626 --- ParallelTerminationStrategy: PID 32367 died... 11:01:11.696056 run iperf3-srv_10.42.42.10(pid=32367): Terminated {rc=256} 11:01:11.739265 --- ParallelTerminationStrategy: PID 32368 died... 11:01:11.757596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32368): Terminated: ok {rc=0} 11:01:11.800809 --- ParallelTerminationStrategy: PID 32369 died... 11:01:11.819636 run iperf3-srv_10.42.42.10(pid=32369): Terminated {rc=256} 11:01:11.862926 --- ParallelTerminationStrategy: PID 32370 died... 11:01:11.881354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32370): Terminated: ok {rc=0} 11:01:11.924768 --- ParallelTerminationStrategy: PID 32371 died... 11:01:11.943135 run iperf3-srv_10.42.42.10(pid=32371): Terminated {rc=256} 11:01:11.986458 --- ParallelTerminationStrategy: PID 32374 died... 11:01:12.004928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32374): Terminated: ok {rc=0} 11:01:12.049060 --- ParallelTerminationStrategy: PID 32377 died... 11:01:12.067526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32377): Terminated: ok {rc=0} 11:01:12.110996 --- ParallelTerminationStrategy: PID 32380 died... 11:01:12.129498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32380): Terminated: ok {rc=0} 11:01:12.214090 bus /gobi_4: Setting Powered False 11:01:13.315447 bus /gobi_4: Setting Powered False 11:01:14.434340 bus /gobi_1: Setting Powered False 11:01:15.532759 bus /gobi_1: Setting Powered False 11:01:16.652637 bus /gobi_0: Setting Powered False 11:01:17.750770 bus /gobi_0: Setting Powered False 11:01:18.866494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:01:19.969427 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:19.982031 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:01:20.034267 tst ping.py: using LAC 27934 11:01:20.159226 tst ping.py: using RAC 139 11:01:20.282924 tst ping.py: using CellId 27934 11:01:20.408769 tst ping.py: using BVCI 27935 11:01:20.524157 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:20.536529 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:20.548392 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:20.560685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:20.572720 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:20.585083 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:20.597196 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:20.609129 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:01:20.724426 tst ping.py:19: start network... 11:01:20.921732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:21.377892 run create_hlr_db(pid=32382): Launched 11:01:21.498743 bus /gobi_6: Setting Powered False 11:01:22.557547 run create_hlr_db(pid=32382): Terminated: ok {rc=0} 11:01:22.968510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32384): Launched 11:01:23.263166 run osmo-hlr_10.42.42.2(pid=32385): Launched 11:01:23.375008 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:23.883003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32387): Launched 11:01:24.177650 run osmo-stp_10.42.42.5(pid=32388): Launched 11:01:24.290316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:24.798540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32390): Launched 11:01:24.911401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:25.159057 run patchelf(pid=32391): Launched 11:01:25.323545 run osmo-stp_10.42.42.5(pid=32388): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32388)] 11:01:25.448449 run osmo-stp_10.42.42.5(pid=32388): stdout: | (launched: 2022-12-10_11:01:24.123631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:25.575126 run osmo-stp_10.42.42.5(pid=32388): stderr: | 20221210110124293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110124294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110124294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110124294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110124295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110124295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110124295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:25.701981 run osmo-stp_10.42.42.5(pid=32388): stdout: | (launched: 2022-12-10_11:01:24.123631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:25.823513 run osmo-stp_10.42.42.5(pid=32388): stderr: | 20221210110124293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110124294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110124294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110124294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110124295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110124295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110124295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:25.966581 run patchelf(pid=32391): Terminating (SIGINT) 11:01:26.132296 run patchelf(pid=32391): Terminated: ok {rc=0} 11:01:26.252070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32388): Process ended prematurely: osmo-stp_10.42.42.5(pid=32388) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32388)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:01:26.260837 tst ping.py:22: Test FAILED (6.3 sec) 11:01:26.287280 run osmo-hlr_10.42.42.2(pid=32385): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32385)] 11:01:26.334381 run osmo-hlr_10.42.42.2(pid=32385): stdout: | (launched: 2022-12-10_11:01:23.209864) 11:01:26.383308 run osmo-hlr_10.42.42.2(pid=32385): stderr: | 20221210110123386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110123387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110123387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110123387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110123387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110123387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110123399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110123409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110123409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110123410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:26.433325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32384): Terminating (SIGTERM) 11:01:26.472871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32387): Terminating (SIGTERM) 11:01:26.512103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32390): Terminating (SIGTERM) 11:01:26.551535 --- ParallelTerminationStrategy: PID 32384 died... 11:01:26.570367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32384): Terminated: ok {rc=0} 11:01:26.614574 --- ParallelTerminationStrategy: PID 32387 died... 11:01:26.632867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32387): Terminated: ok {rc=0} 11:01:26.676385 --- ParallelTerminationStrategy: PID 32390 died... 11:01:26.694964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32390): Terminated: ok {rc=0} 11:01:26.779727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:01:27.867639 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:27.880065 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:01:27.933941 tst ping_idle_ping.py: using LAC 27935 11:01:28.050241 tst ping_idle_ping.py: using RAC 140 11:01:28.166816 tst ping_idle_ping.py: using CellId 27935 11:01:28.282453 tst ping_idle_ping.py: using BVCI 27936 11:01:28.389271 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:28.400811 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:28.412010 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:28.423288 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:28.434576 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:28.445814 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:28.457134 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:01:28.468338 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:01:28.586166 tst ping_idle_ping.py:24: start network... 11:01:28.800548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:29.293524 run create_hlr_db(pid=32392): Launched 11:01:29.416047 bus /gobi_6: Setting Powered False 11:01:30.479206 run create_hlr_db(pid=32392): Terminated: ok {rc=0} 11:01:30.931119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Launched 11:01:31.251750 run osmo-hlr_10.42.42.2(pid=32395): Launched 11:01:31.557006 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:32.151249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Launched 11:01:32.471278 run osmo-stp_10.42.42.5(pid=32398): Launched 11:01:32.585327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:33.103891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32400): Launched 11:01:33.217424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:33.467014 run patchelf(pid=32401): Launched 11:01:33.632354 run osmo-stp_10.42.42.5(pid=32398): ERR: Terminated: ERROR {rc=1} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] 11:01:33.758443 run osmo-stp_10.42.42.5(pid=32398): stdout: | (launched: 2022-12-10_11:01:32.417668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:33.887148 run osmo-stp_10.42.42.5(pid=32398): stderr: | 20221210110132587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110132587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110132588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110132588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110132588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110132589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110132589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:34.015072 run osmo-stp_10.42.42.5(pid=32398): stdout: | (launched: 2022-12-10_11:01:32.417668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:34.136859 run osmo-stp_10.42.42.5(pid=32398): stderr: | 20221210110132587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110132587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110132588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110132588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110132588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110132589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110132589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:34.281168 run patchelf(pid=32401): Terminating (SIGINT) 11:01:34.449883 run patchelf(pid=32401): Terminated: ok {rc=0} 11:01:34.570449 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32398): Process ended prematurely: osmo-stp_10.42.42.5(pid=32398) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:01:34.579257 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:01:34.605959 run osmo-hlr_10.42.42.2(pid=32395): ERR: Terminated: ERROR {rc=237} [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32395)] 11:01:34.653632 run osmo-hlr_10.42.42.2(pid=32395): stdout: | (launched: 2022-12-10_11:01:31.188522) 11:01:34.703355 run osmo-hlr_10.42.42.2(pid=32395): stderr: | 20221210110131430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110131430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110131430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110131430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110131430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110131430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110131447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110131458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110131458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110131459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:34.753487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminating (SIGTERM) 11:01:34.793744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Terminating (SIGTERM) 11:01:34.833905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32400): Terminating (SIGTERM) 11:01:34.874242 --- ParallelTerminationStrategy: PID 32394 died... 11:01:34.893377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminated: ok {rc=0} 11:01:34.937773 --- ParallelTerminationStrategy: PID 32397 died... 11:01:34.956434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Terminated: ok {rc=0} 11:01:35.000623 --- ParallelTerminationStrategy: PID 32400 died... 11:01:35.019490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32400): Terminated: ok {rc=0} 11:01:35.105426 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 11:01:36.427576 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:01:36.435231 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:01:36.467323 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:01:36.501529 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:01:36.552442 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:01:36.583987 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:01:36.617564 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:01:37.181808 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2373 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:01:37.186933 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.198683 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:01:37.264606 tst switch_tch_pdch.py: using LAC 27936 11:01:37.389382 tst switch_tch_pdch.py: using RAC 141 11:01:37.513237 tst switch_tch_pdch.py: using CellId 27936 11:01:37.638625 tst switch_tch_pdch.py: using BVCI 27937 11:01:37.754890 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.766973 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.779237 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.791424 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.803271 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.815334 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.827545 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:01:37.840406 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:01:37.956250 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:01:38.075041 tst switch_tch_pdch.py:51: start network... 11:01:38.288916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:01:38.774828 run create_hlr_db(pid=32405): Launched 11:01:38.894230 bus /gobi_6: Setting Powered False 11:01:39.958306 run create_hlr_db(pid=32405): Terminated: ok {rc=0} 11:01:40.373945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32407): Launched 11:01:40.667425 run osmo-hlr_10.42.42.2(pid=32408): Launched 11:01:40.779618 run osmo-stp_10.42.42.5: Starting osmo-stp 11:01:41.302450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32410): Launched 11:01:41.597291 run osmo-stp_10.42.42.5(pid=32411): Launched 11:01:41.710222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:01:42.223018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32413): Launched 11:01:42.336249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:01:42.585274 run patchelf(pid=32414): Launched 11:01:42.750148 run osmo-stp_10.42.42.5(pid=32411): ERR: Terminated: ERROR {rc=1} [trial-2373↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32411)] 11:01:42.875668 run osmo-stp_10.42.42.5(pid=32411): stdout: | (launched: 2022-12-10_11:01:41.543559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:43.002646 run osmo-stp_10.42.42.5(pid=32411): stderr: | 20221210110141713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110141713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110141713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110141714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110141714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110141714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110141714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:43.129696 run osmo-stp_10.42.42.5(pid=32411): stdout: | (launched: 2022-12-10_11:01:41.543559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:01:43.250701 run osmo-stp_10.42.42.5(pid=32411): stderr: | 20221210110141713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110141713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110141713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110141714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110141714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110141714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110141714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:01:43.394465 run patchelf(pid=32414): Terminating (SIGINT) 11:01:43.560796 run patchelf(pid=32414): Terminated: ok {rc=0} 11:01:43.680427 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32411): Process ended prematurely: osmo-stp_10.42.42.5(pid=32411) [trial-2373↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32411)] [trial-2373↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:01:43.689277 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 11:01:43.715329 run osmo-hlr_10.42.42.2(pid=32408): ERR: Terminated: ERROR {rc=237} [trial-2373↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32408)] 11:01:43.762361 run osmo-hlr_10.42.42.2(pid=32408): stdout: | (launched: 2022-12-10_11:01:40.613920) 11:01:43.811306 run osmo-hlr_10.42.42.2(pid=32408): stderr: | 20221210110140789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110140789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110140790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110140790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110140790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110140790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110140803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110140813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110140813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110140813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:01:43.860602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32407): Terminating (SIGTERM) 11:01:43.900649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32410): Terminating (SIGTERM) 11:01:43.940036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32413): Terminating (SIGTERM) 11:01:43.979532 --- ParallelTerminationStrategy: PID 32407 died... 11:01:43.998331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32407): Terminated: ok {rc=0} 11:01:44.041938 --- ParallelTerminationStrategy: PID 32410 died... 11:01:44.060191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32410): Terminated: ok {rc=0} 11:01:44.103502 --- ParallelTerminationStrategy: PID 32413 died... 11:01:44.121936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32413): Terminated: ok {rc=0} 11:01:44.207332 bus /gobi_0: Setting Powered False 11:01:45.305994 bus /gobi_0: Setting Powered False 11:01:46.419797 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2373 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 nitb_smpp --------------------------------------------------------------------- 11:01:47.674872 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:01:47.677283 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 11:01:47.697575 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 11:01:47.704467 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 11:01:47.738174 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 11:01:47.758557 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 11:01:47.765150 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 11:01:48.285754 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2373 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:01:48.290825 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:01:48.309829 tst esme_connect_policy_acceptall.py: using MSISDN 7695 11:01:48.451064 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:01:49.050834 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32419): Launched 11:01:49.371944 run osmo-nitb_10.42.42.2(pid=32420): Launched 11:01:49.549623 run osmo-nitb_10.42.42.2(pid=32420): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32420)] 11:01:49.693391 run osmo-nitb_10.42.42.2(pid=32420): stdout: | (launched: 2022-12-10_11:01:49.314330) 11:01:49.838638 run osmo-nitb_10.42.42.2(pid=32420): stderr: | (launched: 2022-12-10_11:01:49.362176) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:01:49.983865 run osmo-nitb_10.42.42.2(pid=32420): stdout: | (launched: 2022-12-10_11:01:49.314330) 11:01:50.123499 run osmo-nitb_10.42.42.2(pid=32420): stderr: | (launched: 2022-12-10_11:01:49.362176) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32420): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32420) [trial-2373↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32420)] 11:01:50.493590 tst osmo-nitb_10.42.42.2(pid=32420): stdout: | (launched: 2022-12-10_11:01:49.314330) 11:01:50.623510 tst osmo-nitb_10.42.42.2(pid=32420): stderr: | (launched: 2022-12-10_11:01:49.362176) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:01:50.776702 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=32420): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32420) [trial-2373↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32420)] [trial-2373↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 11:01:50.785567 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 11:01:50.792735 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32419): Terminating (SIGTERM) 11:01:51.004129 --- ParallelTerminationStrategy: PID 32419 died... 11:01:51.025512 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32419): Terminated: ok {rc=0} ---------------------------------------------- trial-2373 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 11:01:51.076932 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:01:51.098433 tst esme_connect_policy_closed.py: using MSISDN 7696 11:01:51.227972 tst esme_connect_policy_closed.py: using MSISDN 7697 11:01:51.345140 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:01:51.944250 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32421): Launched 11:01:52.266396 run osmo-nitb_10.42.42.2(pid=32422): Launched 11:01:52.440507 run osmo-nitb_10.42.42.2(pid=32422): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32422)] 11:01:52.573424 run osmo-nitb_10.42.42.2(pid=32422): stdout: | (launched: 2022-12-10_11:01:52.208185) 11:01:52.707701 run osmo-nitb_10.42.42.2(pid=32422): stderr: | (launched: 2022-12-10_11:01:52.256525) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:01:52.841726 run osmo-nitb_10.42.42.2(pid=32422): stdout: | (launched: 2022-12-10_11:01:52.208185) 11:01:52.970043 run osmo-nitb_10.42.42.2(pid=32422): stderr: | (launched: 2022-12-10_11:01:52.256525) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:01:53.124142 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=32422): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32422) [trial-2373↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32422)] [trial-2373↪nitb_smpp↪esme_connect_policy_closed.py:24] 11:01:53.133195 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 11:01:53.140033 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32421): Terminating (SIGTERM) 11:01:53.351249 --- ParallelTerminationStrategy: PID 32421 died... 11:01:53.372489 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32421): Terminated: ok {rc=0} ---------------------------------------------- trial-2373 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:01:53.423910 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:01:53.435556 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:01:53.472618 tst esme_ms_sms_storeforward.py: using LAC 27937 11:01:53.599587 tst esme_ms_sms_storeforward.py: using RAC 142 11:01:53.725926 tst esme_ms_sms_storeforward.py: using CellId 27937 11:01:53.851865 tst esme_ms_sms_storeforward.py: using BVCI 27938 11:01:53.969007 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:01:54.095153 tst esme_ms_sms_storeforward.py: using MSISDN 7698 11:01:54.206033 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 11:01:54.412094 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:01:55.032358 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32423): Launched 11:01:55.336059 run osmo-nitb_10.42.42.2(pid=32424): Launched 11:01:55.500049 run osmo-nitb_10.42.42.2(pid=32424): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32424)] 11:01:55.624683 run osmo-nitb_10.42.42.2(pid=32424): stdout: | (launched: 2022-12-10_11:01:55.281168) 11:01:55.750455 run osmo-nitb_10.42.42.2(pid=32424): stderr: | (launched: 2022-12-10_11:01:55.326307) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:01:55.876377 run osmo-nitb_10.42.42.2(pid=32424): stdout: | (launched: 2022-12-10_11:01:55.281168) 11:01:55.997603 run osmo-nitb_10.42.42.2(pid=32424): stderr: | (launched: 2022-12-10_11:01:55.326307) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:01:56.143079 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=32424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32424) [trial-2373↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32424)] [trial-2373↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 11:01:56.151037 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 11:01:56.157425 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32423): Terminating (SIGTERM) 11:01:56.365733 --- ParallelTerminationStrategy: PID 32423 died... 11:01:56.386497 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32423): Terminated: ok {rc=0} 11:01:56.471846 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:01:57.559473 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 11:01:57.570569 tst nitb_smpp: Using 1 x bts (candidates: 1) 11:01:57.608322 tst esme_ms_sms_transaction.py: using LAC 27938 11:01:57.729281 tst esme_ms_sms_transaction.py: using RAC 143 11:01:57.848205 tst esme_ms_sms_transaction.py: using CellId 27938 11:01:57.968659 tst esme_ms_sms_transaction.py: using BVCI 27939 11:01:58.079198 tst nitb_smpp: Using 1 x modem (candidates: 1) 11:01:58.206728 tst esme_ms_sms_transaction.py: using MSISDN 7699 11:01:58.325946 tst esme_ms_sms_transaction.py:18: start nitb and bts... 11:01:58.545488 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:01:59.199770 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32425): Launched 11:01:59.520456 run osmo-nitb_10.42.42.2(pid=32426): Launched 11:01:59.699255 run osmo-nitb_10.42.42.2(pid=32426): ERR: Terminated: ERROR {rc=2} [trial-2373↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32426)] 11:01:59.843870 run osmo-nitb_10.42.42.2(pid=32426): stdout: | (launched: 2022-12-10_11:01:59.463082) 11:01:59.990061 run osmo-nitb_10.42.42.2(pid=32426): stderr: | (launched: 2022-12-10_11:01:59.510647) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:02:00.136565 run osmo-nitb_10.42.42.2(pid=32426): stdout: | (launched: 2022-12-10_11:01:59.463082) 11:02:00.277795 run osmo-nitb_10.42.42.2(pid=32426): stderr: | (launched: 2022-12-10_11:01:59.510647) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f10e47d5268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32426): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32426) [trial-2373↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32426)] 11:02:00.642570 tst osmo-nitb_10.42.42.2(pid=32426): stdout: | (launched: 2022-12-10_11:01:59.463082) 11:02:00.773933 tst osmo-nitb_10.42.42.2(pid=32426): stderr: | (launched: 2022-12-10_11:01:59.510647) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:02:00.946793 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=32426): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32426) [trial-2373↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32426)] [trial-2373↪nitb_smpp↪esme_ms_sms_transaction.py:21] 11:02:00.956131 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 11:02:00.963580 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32425): Terminating (SIGTERM) 11:02:01.176301 --- ParallelTerminationStrategy: PID 32425 died... 11:02:01.196426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32425): Terminated: ok {rc=0} 11:02:01.287206 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 smpp --------------------------------------------------------------------- 11:02:02.460647 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:02:02.463737 tst smpp: Verifying 1 x bts (candidates: 11) 11:02:02.484505 tst smpp: Verifying 6 x ip_address (candidates: 9) 11:02:02.511546 tst smpp: Verifying 1 x modem (candidates: 12) 11:02:02.546208 tst smpp: Reserving 1 x bts (candidates: 11) 11:02:02.566655 tst smpp: Reserving 6 x ip_address (candidates: 9) 11:02:02.593039 tst smpp: Reserving 1 x modem (candidates: 12) 11:02:03.120362 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 11:02:03.127232 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:03.139411 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:03.151122 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:03.162940 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:03.182674 tst esme_connect_policy_acceptall.py: using MSISDN 7700 11:02:03.302660 run osmo-stp_10.42.42.4: Starting osmo-stp 11:02:03.854715 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32430): Launched 11:02:04.177117 run osmo-stp_10.42.42.4(pid=32431): Launched 11:02:04.301816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:04.802072 run create_hlr_db(pid=32432): Launched 11:02:04.924661 bus /sierra_2: Setting Powered False 11:02:05.988362 run create_hlr_db(pid=32432): Terminated: ok {rc=0} 11:02:06.419316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32434): Launched 11:02:06.721289 run osmo-hlr_10.42.42.2(pid=32435): Launched 11:02:06.837167 run osmo-msc_10.42.42.5: Starting osmo-msc 11:02:07.386105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32437): Launched 11:02:07.688257 run osmo-msc_10.42.42.5(pid=32438): Launched 11:02:07.857329 run osmo-hlr_10.42.42.2(pid=32435): ERR: Terminated: ERROR {rc=237} [trial-2373↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32435)] 11:02:07.987147 run osmo-hlr_10.42.42.2(pid=32435): stdout: | (launched: 2022-12-10_11:02:06.666775) 11:02:08.116417 run osmo-hlr_10.42.42.2(pid=32435): stderr: | 20221210110206842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110206842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110206934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110206943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110206943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110206943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:08.242378 run osmo-hlr_10.42.42.2(pid=32435): stdout: | (launched: 2022-12-10_11:02:06.666775) 11:02:08.363175 run osmo-hlr_10.42.42.2(pid=32435): stderr: | 20221210110206842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110206842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110206842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110206934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110206943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110206943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110206943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:08.507246 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=32435): Process ended prematurely: osmo-hlr_10.42.42.2(pid=32435) [trial-2373↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32435)] [trial-2373↪smpp↪esme_connect_policy_acceptall.py:23] 11:02:08.515437 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.4 sec) 11:02:08.541285 run osmo-msc_10.42.42.5(pid=32438): ERR: Terminated: ERROR {rc=9} [trial-2373↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=32438)] 11:02:08.588816 run osmo-msc_10.42.42.5(pid=32438): stdout: | (launched: 2022-12-10_11:02:07.633431) 11:02:08.638024 run osmo-msc_10.42.42.5(pid=32438): stderr: | 20221210110207945 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210110207945 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210110207945 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110207945 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210110207945 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210110207945 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210110207946 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210110207946 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210110207946 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:02:08.687304 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32430): Terminating (SIGTERM) 11:02:08.726812 run osmo-stp_10.42.42.4(pid=32431): Terminating (SIGTERM) 11:02:08.766257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32434): Terminating (SIGTERM) 11:02:08.807225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32437): Terminating (SIGTERM) 11:02:08.847968 --- ParallelTerminationStrategy: PID 32430 died... 11:02:08.867147 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32430): Terminated: ok {rc=0} 11:02:08.911327 --- ParallelTerminationStrategy: PID 32431 died... 11:02:08.929889 run osmo-stp_10.42.42.4(pid=32431): Terminated: ok {rc=0} 11:02:08.973683 --- ParallelTerminationStrategy: PID 32434 died... 11:02:08.992232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32434): Terminated: ok {rc=0} 11:02:09.036199 --- ParallelTerminationStrategy: PID 32437 died... 11:02:09.054907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32437): Terminated: ok {rc=0} ---------------------------------------------- trial-2373 smpp esme_connect_policy_closed.py ---------------------------------------------- 11:02:09.103281 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:09.114237 tst smpp: Using 1 x bts (candidates: 1) 11:02:09.174813 tst esme_connect_policy_closed.py: using LAC 27939 11:02:09.295665 tst esme_connect_policy_closed.py: using RAC 144 11:02:09.413029 tst esme_connect_policy_closed.py: using CellId 27939 11:02:09.530606 tst esme_connect_policy_closed.py: using BVCI 27940 11:02:09.641506 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:09.651803 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:09.662099 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:09.680326 tst esme_connect_policy_closed.py: using MSISDN 7701 11:02:09.799232 tst esme_connect_policy_closed.py: using MSISDN 7702 11:02:09.908761 run osmo-stp_10.42.42.4: Starting osmo-stp 11:02:10.427039 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32441): Launched 11:02:10.730178 run osmo-stp_10.42.42.4(pid=32442): Launched 11:02:10.846441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:11.315215 run create_hlr_db(pid=32443): Launched 11:02:12.493904 run create_hlr_db(pid=32443): Terminated: ok {rc=0} 11:02:12.813688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Launched 11:02:13.117153 run osmo-hlr_10.42.42.2(pid=32446): Launched 11:02:13.233633 run osmo-msc_10.42.42.5: Starting osmo-msc 11:02:13.784360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Launched 11:02:14.088238 run osmo-msc_10.42.42.5(pid=32449): Launched 11:02:14.259508 run osmo-hlr_10.42.42.2(pid=32446): ERR: Terminated: ERROR {rc=237} [trial-2373↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32446)] 11:02:14.389676 run osmo-hlr_10.42.42.2(pid=32446): stdout: | (launched: 2022-12-10_11:02:13.062336) 11:02:14.518973 run osmo-hlr_10.42.42.2(pid=32446): stderr: | 20221210110213237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110213237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110213253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110213264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110213265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110213265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:14.645839 run osmo-hlr_10.42.42.2(pid=32446): stdout: | (launched: 2022-12-10_11:02:13.062336) 11:02:14.766854 run osmo-hlr_10.42.42.2(pid=32446): stderr: | 20221210110213237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110213237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110213237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110213253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110213264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110213265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110213265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:14.911831 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=32446): Process ended prematurely: osmo-hlr_10.42.42.2(pid=32446) [trial-2373↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32446)] [trial-2373↪smpp↪esme_connect_policy_closed.py:31] 11:02:14.919850 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec) 11:02:14.945774 run osmo-msc_10.42.42.5(pid=32449): ERR: Terminated: ERROR {rc=9} [trial-2373↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=32449)] 11:02:14.993863 run osmo-msc_10.42.42.5(pid=32449): stdout: | (launched: 2022-12-10_11:02:14.032860) 11:02:15.043435 run osmo-msc_10.42.42.5(pid=32449): stderr: | 20221210110214347 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210110214347 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210110214347 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110214347 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210110214347 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210110214347 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210110214347 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210110214347 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210110214347 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 11:02:15.093474 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32441): Terminating (SIGTERM) 11:02:15.133266 run osmo-stp_10.42.42.4(pid=32442): Terminating (SIGTERM) 11:02:15.173218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Terminating (SIGTERM) 11:02:15.214103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Terminating (SIGTERM) 11:02:15.256482 --- ParallelTerminationStrategy: PID 32441 died... 11:02:15.276032 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32441): Terminated: ok {rc=0} 11:02:15.320241 --- ParallelTerminationStrategy: PID 32442 died... 11:02:15.339065 run osmo-stp_10.42.42.4(pid=32442): Terminated: ok {rc=0} 11:02:15.383592 --- ParallelTerminationStrategy: PID 32445 died... 11:02:15.402221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32445): Terminated: ok {rc=0} 11:02:15.446477 --- ParallelTerminationStrategy: PID 32448 died... 11:02:15.465207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32448): Terminated: ok {rc=0} ---------------------------------------------- trial-2373 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 11:02:15.514294 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:15.525190 tst smpp: Using 1 x bts (candidates: 1) 11:02:15.558425 tst esme_ms_sms_storeforward.py: using LAC 27940 11:02:15.677599 tst esme_ms_sms_storeforward.py: using RAC 145 11:02:15.804074 tst esme_ms_sms_storeforward.py: using CellId 27940 11:02:15.940300 tst esme_ms_sms_storeforward.py: using BVCI 27941 11:02:16.052433 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:16.063430 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:16.074249 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:16.085433 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:16.096542 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:16.107845 tst smpp: Using 1 x modem (candidates: 1) 11:02:16.230693 tst esme_ms_sms_storeforward.py: using MSISDN 7703 11:02:16.343275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:16.821982 run create_hlr_db(pid=32452): Launched 11:02:18.036403 run create_hlr_db(pid=32452): Terminated: ok {rc=0} 11:02:18.357956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32454): Launched 11:02:18.661786 run osmo-hlr_10.42.42.2(pid=32455): Launched 11:02:18.779207 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:19.318394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32457): Launched 11:02:19.622685 run osmo-stp_10.42.42.5(pid=32458): Launched 11:02:19.739951 run osmo-msc_10.42.42.6: Starting osmo-msc 11:02:20.287458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32460): Launched 11:02:20.591068 run osmo-msc_10.42.42.6(pid=32461): Launched 11:02:20.760717 run osmo-stp_10.42.42.5(pid=32458): ERR: Terminated: ERROR {rc=1} [trial-2373↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32458)] 11:02:20.889863 run osmo-stp_10.42.42.5(pid=32458): stdout: | (launched: 2022-12-10_11:02:19.567918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:21.017681 run osmo-stp_10.42.42.5(pid=32458): stderr: | 20221210110219737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110219737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110219737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110219738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110219738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110219738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110219738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:21.143893 run osmo-stp_10.42.42.5(pid=32458): stdout: | (launched: 2022-12-10_11:02:19.567918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:21.264237 run osmo-stp_10.42.42.5(pid=32458): stderr: | 20221210110219737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110219737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110219737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110219738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110219738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110219738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110219738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:21.408011 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=32458): Process ended prematurely: osmo-stp_10.42.42.5(pid=32458) [trial-2373↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32458)] [trial-2373↪smpp↪esme_ms_sms_storeforward.py:30] 11:02:21.416113 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 11:02:21.441869 run osmo-hlr_10.42.42.2(pid=32455): ERR: Terminated: ERROR {rc=237} [trial-2373↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32455)] 11:02:21.489166 run osmo-hlr_10.42.42.2(pid=32455): stdout: | (launched: 2022-12-10_11:02:18.606885) 11:02:21.538227 run osmo-hlr_10.42.42.2(pid=32455): stderr: | 20221210110218780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110218781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110218781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110218781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110218781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110218781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110218793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110218801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110218801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110218801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:21.607033 run osmo-msc_10.42.42.6(pid=32461): ERR: Terminated: ERROR {rc=2} [trial-2373↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32461)] 11:02:21.654807 run osmo-msc_10.42.42.6(pid=32461): stdout: | (launched: 2022-12-10_11:02:20.536171) 11:02:21.703754 run osmo-msc_10.42.42.6(pid=32461): stderr: | 20221210110220808 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110220808 DLGLOBAL DEBUG validating counter group 0x7f37aa252c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110220808 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110220808 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110220808 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110220809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110220811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110220812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110220812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110220812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:02:21.753124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32454): Terminating (SIGTERM) 11:02:21.792764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32457): Terminating (SIGTERM) 11:02:21.832548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32460): Terminating (SIGTERM) 11:02:21.872398 --- ParallelTerminationStrategy: PID 32454 died... 11:02:21.891430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32454): Terminated: ok {rc=0} 11:02:21.935129 --- ParallelTerminationStrategy: PID 32457 died... 11:02:21.953538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32457): Terminated: ok {rc=0} 11:02:21.996894 --- ParallelTerminationStrategy: PID 32460 died... 11:02:22.015738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32460): Terminated: ok {rc=0} 11:02:22.100183 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 smpp esme_ms_sms_transaction.py ---------------------------------------------- 11:02:23.188070 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:23.199085 tst smpp: Using 1 x bts (candidates: 1) 11:02:23.234895 tst esme_ms_sms_transaction.py: using LAC 27941 11:02:23.356626 tst esme_ms_sms_transaction.py: using RAC 146 11:02:23.480216 tst esme_ms_sms_transaction.py: using CellId 27941 11:02:23.598330 tst esme_ms_sms_transaction.py: using BVCI 27942 11:02:23.709395 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:23.719578 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:23.729808 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:23.739985 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:23.750095 tst smpp: Using 1 x ip_address (candidates: 6) 11:02:23.760111 tst smpp: Using 1 x modem (candidates: 1) 11:02:23.889961 tst esme_ms_sms_transaction.py: using MSISDN 7704 11:02:24.008711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:24.509771 run create_hlr_db(pid=32463): Launched 11:02:24.634187 bus /sierra_2: Setting Powered False 11:02:25.698576 run create_hlr_db(pid=32463): Terminated: ok {rc=0} 11:02:26.133408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32465): Launched 11:02:26.439670 run osmo-hlr_10.42.42.2(pid=32466): Launched 11:02:26.557118 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:27.096413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32468): Launched 11:02:27.399415 run osmo-stp_10.42.42.5(pid=32469): Launched 11:02:27.515786 run osmo-msc_10.42.42.6: Starting osmo-msc 11:02:28.064002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32471): Launched 11:02:28.368382 run osmo-msc_10.42.42.6(pid=32472): Launched 11:02:28.538519 run osmo-stp_10.42.42.5(pid=32469): ERR: Terminated: ERROR {rc=1} [trial-2373↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32469)] 11:02:28.666674 run osmo-stp_10.42.42.5(pid=32469): stdout: | (launched: 2022-12-10_11:02:27.344625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:28.794851 run osmo-stp_10.42.42.5(pid=32469): stderr: | 20221210110227515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110227516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110227516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110227516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110227517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110227517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110227517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:28.920743 run osmo-stp_10.42.42.5(pid=32469): stdout: | (launched: 2022-12-10_11:02:27.344625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:29.041423 run osmo-stp_10.42.42.5(pid=32469): stderr: | 20221210110227515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110227516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110227516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110227516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110227517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110227517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110227517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:29.185589 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=32469): Process ended prematurely: osmo-stp_10.42.42.5(pid=32469) [trial-2373↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32469)] [trial-2373↪smpp↪esme_ms_sms_transaction.py:28] 11:02:29.193624 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 11:02:29.219701 run osmo-hlr_10.42.42.2(pid=32466): ERR: Terminated: ERROR {rc=237} [trial-2373↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32466)] 11:02:29.267422 run osmo-hlr_10.42.42.2(pid=32466): stdout: | (launched: 2022-12-10_11:02:26.384343) 11:02:29.317079 run osmo-hlr_10.42.42.2(pid=32466): stderr: | 20221210110226563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110226563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110226563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110226563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110226563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110226563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110226574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110226583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110226583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110226583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:29.386421 run osmo-msc_10.42.42.6(pid=32472): ERR: Terminated: ERROR {rc=2} [trial-2373↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32472)] 11:02:29.434197 run osmo-msc_10.42.42.6(pid=32472): stdout: | (launched: 2022-12-10_11:02:28.313656) 11:02:29.483462 run osmo-msc_10.42.42.6(pid=32472): stderr: | 20221210110228582 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110228582 DLGLOBAL DEBUG validating counter group 0x7f9e69794c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110228582 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110228582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110228582 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110228582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110228584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110228585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110228585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110228585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:02:29.533096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32465): Terminating (SIGTERM) 11:02:29.572509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32468): Terminating (SIGTERM) 11:02:29.612218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32471): Terminating (SIGTERM) 11:02:29.652029 --- ParallelTerminationStrategy: PID 32465 died... 11:02:29.671104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32465): Terminated: ok {rc=0} 11:02:29.715615 --- ParallelTerminationStrategy: PID 32468 died... 11:02:29.734311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32468): Terminated: ok {rc=0} 11:02:29.778257 --- ParallelTerminationStrategy: PID 32471 died... 11:02:29.796903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32471): Terminated: ok {rc=0} 11:02:29.880502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 encryption --------------------------------------------------------------------- 11:02:31.082200 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:02:31.087573 tst encryption: Verifying 1 x bts (candidates: 11) 11:02:31.120996 tst encryption: Verifying 6 x ip_address (candidates: 9) 11:02:31.158975 tst encryption: Verifying 1 x modem (candidates: 12) 11:02:31.205358 tst encryption: Reserving 1 x bts (candidates: 11) 11:02:31.236204 tst encryption: Reserving 6 x ip_address (candidates: 9) 11:02:31.276526 tst encryption: Reserving 1 x modem (candidates: 12) 11:02:31.781491 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2373 encryption register_a5_0_authopt.py ---------------------------------------------- 11:02:31.840679 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:31.853230 tst encryption: Using 1 x bts (candidates: 1) 11:02:31.893743 tst register_a5_0_authopt.py: using LAC 27942 11:02:32.016683 tst register_a5_0_authopt.py: using RAC 147 11:02:32.149163 tst register_a5_0_authopt.py: using CellId 27942 11:02:32.270577 tst register_a5_0_authopt.py: using BVCI 27943 11:02:32.383339 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:32.393758 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:32.404015 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:32.414230 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:32.424339 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:32.434461 tst encryption: Using 1 x modem (candidates: 1) 11:02:32.552933 tst register_a5_0_authopt.py:8: start network... 11:02:32.775095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:33.280323 run create_hlr_db(pid=32477): Launched 11:02:33.406870 bus /sierra_2: Setting Powered False 11:02:34.471665 run create_hlr_db(pid=32477): Terminated: ok {rc=0} 11:02:34.925713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32479): Launched 11:02:35.253099 run osmo-hlr_10.42.42.2(pid=32480): Launched 11:02:35.379708 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:35.947055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Launched 11:02:36.276278 run osmo-stp_10.42.42.5(pid=32484): Launched 11:02:36.397616 run osmo-msc_10.42.42.6: Starting osmo-msc 11:02:36.950478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32486): Launched 11:02:37.255837 run osmo-msc_10.42.42.6(pid=32487): Launched 11:02:37.427653 run osmo-stp_10.42.42.5(pid=32484): ERR: Terminated: ERROR {rc=1} [trial-2373↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] 11:02:37.557101 run osmo-stp_10.42.42.5(pid=32484): stdout: | (launched: 2022-12-10_11:02:36.217522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:37.686730 run osmo-stp_10.42.42.5(pid=32484): stderr: | 20221210110236389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110236389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110236389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110236390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110236390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110236390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110236390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:37.813850 run osmo-stp_10.42.42.5(pid=32484): stdout: | (launched: 2022-12-10_11:02:36.217522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:37.935509 run osmo-stp_10.42.42.5(pid=32484): stderr: | 20221210110236389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110236389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110236389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110236390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110236390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110236390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110236390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:38.081200 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32484): Process ended prematurely: osmo-stp_10.42.42.5(pid=32484) [trial-2373↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] [trial-2373↪encryption↪register_a5_0_authopt.py:8] 11:02:38.090093 tst register_a5_0_authopt.py:8: Test FAILED (6.3 sec) 11:02:38.116099 run osmo-hlr_10.42.42.2(pid=32480): ERR: Terminated: ERROR {rc=237} [trial-2373↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32480)] 11:02:38.163616 run osmo-hlr_10.42.42.2(pid=32480): stdout: | (launched: 2022-12-10_11:02:35.194206) 11:02:38.212720 run osmo-hlr_10.42.42.2(pid=32480): stderr: | 20221210110235392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110235392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110235392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110235392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110235392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110235392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110235404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110235413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110235413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110235413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:38.281087 run osmo-msc_10.42.42.6(pid=32487): ERR: Terminated: ERROR {rc=2} [trial-2373↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32487)] 11:02:38.328822 run osmo-msc_10.42.42.6(pid=32487): stdout: | (launched: 2022-12-10_11:02:37.200334) 11:02:38.378084 run osmo-msc_10.42.42.6(pid=32487): stderr: | 20221210110237470 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110237470 DLGLOBAL DEBUG validating counter group 0x7f38443d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110237470 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110237470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110237470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110237470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110237473 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110237473 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110237474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110237474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:02:38.427400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32479): Terminating (SIGTERM) 11:02:38.466779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Terminating (SIGTERM) 11:02:38.506443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32486): Terminating (SIGTERM) 11:02:38.546490 --- ParallelTerminationStrategy: PID 32479 died... 11:02:38.565350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32479): Terminated: ok {rc=0} 11:02:38.608810 --- ParallelTerminationStrategy: PID 32483 died... 11:02:38.627216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Terminated: ok {rc=0} 11:02:38.670707 --- ParallelTerminationStrategy: PID 32486 died... 11:02:38.689164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32486): Terminated: ok {rc=0} 11:02:38.771446 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 encryption register_a5_0_authreq.py ---------------------------------------------- 11:02:39.923538 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:39.935217 tst encryption: Using 1 x bts (candidates: 1) 11:02:39.973592 tst register_a5_0_authreq.py: using LAC 27943 11:02:40.095472 tst register_a5_0_authreq.py: using RAC 148 11:02:40.217992 tst register_a5_0_authreq.py: using CellId 27943 11:02:40.339334 tst register_a5_0_authreq.py: using BVCI 27944 11:02:40.451987 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:40.462678 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:40.473282 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:40.483622 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:40.494000 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:40.504228 tst encryption: Using 1 x modem (candidates: 1) 11:02:40.618935 tst register_a5_0_authreq.py:8: start network... 11:02:40.826101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:41.301209 run create_hlr_db(pid=32489): Launched 11:02:41.426389 bus /sierra_2: Setting Powered False 11:02:42.487653 run create_hlr_db(pid=32489): Terminated: ok {rc=0} 11:02:42.936493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Launched 11:02:43.264407 run osmo-hlr_10.42.42.2(pid=32492): Launched 11:02:43.390711 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:43.958588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Launched 11:02:44.285355 run osmo-stp_10.42.42.5(pid=32495): Launched 11:02:44.411294 run osmo-msc_10.42.42.6: Starting osmo-msc 11:02:45.001566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32497): Launched 11:02:45.330890 run osmo-msc_10.42.42.6(pid=32498): Launched 11:02:45.513328 run osmo-stp_10.42.42.5(pid=32495): ERR: Terminated: ERROR {rc=1} [trial-2373↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] 11:02:45.654498 run osmo-stp_10.42.42.5(pid=32495): stdout: | (launched: 2022-12-10_11:02:44.226577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:45.792058 run osmo-stp_10.42.42.5(pid=32495): stderr: | 20221210110244420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110244420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110244420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110244421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110244421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110244421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110244421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:45.965190 run osmo-stp_10.42.42.5(pid=32495): stdout: | (launched: 2022-12-10_11:02:44.226577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:46.094852 run osmo-stp_10.42.42.5(pid=32495): stderr: | 20221210110244420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110244420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110244420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110244421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110244421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110244421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110244421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:46.244395 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32495): Process ended prematurely: osmo-stp_10.42.42.5(pid=32495) [trial-2373↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] [trial-2373↪encryption↪register_a5_0_authreq.py:8] 11:02:46.253891 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 11:02:46.282431 run osmo-hlr_10.42.42.2(pid=32492): ERR: Terminated: ERROR {rc=237} [trial-2373↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32492)] 11:02:46.331109 run osmo-hlr_10.42.42.2(pid=32492): stdout: | (launched: 2022-12-10_11:02:43.205955) 11:02:46.382175 run osmo-hlr_10.42.42.2(pid=32492): stderr: | 20221210110243405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110243405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110243405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110243405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110243405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110243405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110243417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110243425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110243426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110243426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:46.452581 run osmo-msc_10.42.42.6(pid=32498): ERR: Terminated: ERROR {rc=2} [trial-2373↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32498)] 11:02:46.503056 run osmo-msc_10.42.42.6(pid=32498): stdout: | (launched: 2022-12-10_11:02:45.271363) 11:02:46.553580 run osmo-msc_10.42.42.6(pid=32498): stderr: | 20221210110245594 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110245594 DLGLOBAL DEBUG validating counter group 0x7f779412ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110245594 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110245594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110245594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110245594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110245596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110245596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110245596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110245597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:02:46.604668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Terminating (SIGTERM) 11:02:46.646253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Terminating (SIGTERM) 11:02:46.691092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32497): Terminating (SIGTERM) 11:02:46.734773 --- ParallelTerminationStrategy: PID 32491 died... 11:02:46.754387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Terminated: ok {rc=0} 11:02:46.801068 --- ParallelTerminationStrategy: PID 32494 died... 11:02:46.820381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Terminated: ok {rc=0} 11:02:46.865863 --- ParallelTerminationStrategy: PID 32497 died... 11:02:46.886418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32497): Terminated: ok {rc=0} 11:02:46.971656 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 encryption register_a5_1_authreq.py ---------------------------------------------- 11:02:48.121793 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:48.133555 tst encryption: Using 1 x bts (candidates: 1) 11:02:48.172034 tst register_a5_1_authreq.py: using LAC 27944 11:02:48.302354 tst register_a5_1_authreq.py: using RAC 149 11:02:48.430850 tst register_a5_1_authreq.py: using CellId 27944 11:02:48.559256 tst register_a5_1_authreq.py: using BVCI 27945 11:02:48.678768 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:48.689756 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:48.700601 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:48.712259 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:48.723865 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:48.735250 tst encryption: Using 1 x modem (candidates: 1) 11:02:48.855152 tst register_a5_1_authreq.py:8: start network... 11:02:49.077446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:49.583471 run create_hlr_db(pid=32500): Launched 11:02:49.708794 bus /sierra_2: Setting Powered False 11:02:50.772941 run create_hlr_db(pid=32500): Terminated: ok {rc=0} 11:02:51.227348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32502): Launched 11:02:51.554439 run osmo-hlr_10.42.42.2(pid=32503): Launched 11:02:51.680329 run osmo-stp_10.42.42.5: Starting osmo-stp 11:02:52.246860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32505): Launched 11:02:52.575663 run osmo-stp_10.42.42.5(pid=32506): Launched 11:02:52.702207 run osmo-msc_10.42.42.6: Starting osmo-msc 11:02:53.293162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32508): Launched 11:02:53.620087 run osmo-msc_10.42.42.6(pid=32509): Launched 11:02:53.803442 run osmo-stp_10.42.42.5(pid=32506): ERR: Terminated: ERROR {rc=1} [trial-2373↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32506)] 11:02:53.941917 run osmo-stp_10.42.42.5(pid=32506): stdout: | (launched: 2022-12-10_11:02:52.516595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:54.080578 run osmo-stp_10.42.42.5(pid=32506): stderr: | 20221210110252708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110252708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110252708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110252709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110252709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110252709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110252709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:54.218445 run osmo-stp_10.42.42.5(pid=32506): stdout: | (launched: 2022-12-10_11:02:52.516595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:02:54.349425 run osmo-stp_10.42.42.5(pid=32506): stderr: | 20221210110252708 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110252708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110252708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110252709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110252709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110252709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110252709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:02:54.505790 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32506): Process ended prematurely: osmo-stp_10.42.42.5(pid=32506) [trial-2373↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32506)] [trial-2373↪encryption↪register_a5_1_authreq.py:8] 11:02:54.515319 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 11:02:54.543573 run osmo-hlr_10.42.42.2(pid=32503): ERR: Terminated: ERROR {rc=237} [trial-2373↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32503)] 11:02:54.593754 run osmo-hlr_10.42.42.2(pid=32503): stdout: | (launched: 2022-12-10_11:02:51.495486) 11:02:54.645607 run osmo-hlr_10.42.42.2(pid=32503): stderr: | 20221210110251696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110251696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110251696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110251696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110251696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110251696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110251709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110251717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110251717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110251717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:02:54.717728 run osmo-msc_10.42.42.6(pid=32509): ERR: Terminated: ERROR {rc=2} [trial-2373↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32509)] 11:02:54.767779 run osmo-msc_10.42.42.6(pid=32509): stdout: | (launched: 2022-12-10_11:02:53.561371) 11:02:54.819436 run osmo-msc_10.42.42.6(pid=32509): stderr: | 20221210110253883 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110253883 DLGLOBAL DEBUG validating counter group 0x7ff72d11cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110253883 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110253883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110253883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110253883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110253885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110253885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110253885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110253886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:02:54.871797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32502): Terminating (SIGTERM) 11:02:54.913704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32505): Terminating (SIGTERM) 11:02:54.955974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32508): Terminating (SIGTERM) 11:02:54.998268 --- ParallelTerminationStrategy: PID 32502 died... 11:02:55.018332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32502): Terminated: ok {rc=0} 11:02:55.064900 --- ParallelTerminationStrategy: PID 32505 died... 11:02:55.084591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32505): Terminated: ok {rc=0} 11:02:55.131109 --- ParallelTerminationStrategy: PID 32508 died... 11:02:55.150679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32508): Terminated: ok {rc=0} 11:02:55.238462 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2373 encryption register_a5_3_authreq.py ---------------------------------------------- 11:02:56.390797 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:56.402713 tst encryption: Using 1 x bts (candidates: 1) 11:02:56.440803 tst register_a5_3_authreq.py: using LAC 27945 11:02:56.570969 tst register_a5_3_authreq.py: using RAC 150 11:02:56.700468 tst register_a5_3_authreq.py: using CellId 27945 11:02:56.831201 tst register_a5_3_authreq.py: using BVCI 27946 11:02:56.950466 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:56.961383 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:56.972178 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:56.983169 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:56.994218 tst encryption: Using 1 x ip_address (candidates: 6) 11:02:57.005157 tst encryption: Using 1 x modem (candidates: 1) 11:02:57.130949 tst register_a5_3_authreq.py:8: start network... 11:02:57.337954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:02:57.810656 run create_hlr_db(pid=32511): Launched 11:02:57.935822 bus /sierra_2: Setting Powered False 11:02:58.997926 run create_hlr_db(pid=32511): Terminated: ok {rc=0} 11:02:59.424369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32513): Launched 11:02:59.731259 run osmo-hlr_10.42.42.2(pid=32514): Launched 11:02:59.849923 run osmo-stp_10.42.42.5: Starting osmo-stp 11:03:00.374787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32516): Launched 11:03:00.680934 run osmo-stp_10.42.42.5(pid=32517): Launched 11:03:00.803464 run osmo-msc_10.42.42.6: Starting osmo-msc 11:03:01.510145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32521): Launched 11:03:01.837962 run osmo-msc_10.42.42.6(pid=32522): Launched 11:03:02.312322 run osmo-stp_10.42.42.5(pid=32517): ERR: Terminated: ERROR {rc=1} [trial-2373↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32517)] 11:03:02.475785 run osmo-stp_10.42.42.5(pid=32517): stdout: | (launched: 2022-12-10_11:03:00.625832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:02.612245 run osmo-stp_10.42.42.5(pid=32517): stderr: | 20221210110300803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110300803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110300803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110300804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110300804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110300804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110300804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:02.748777 run osmo-stp_10.42.42.5(pid=32517): stdout: | (launched: 2022-12-10_11:03:00.625832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:03:02.878480 run osmo-stp_10.42.42.5(pid=32517): stderr: | 20221210110300803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110300803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110300803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110300804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110300804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110300804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110300804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:03:03.033991 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32517): Process ended prematurely: osmo-stp_10.42.42.5(pid=32517) [trial-2373↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32517)] [trial-2373↪encryption↪register_a5_3_authreq.py:8] 11:03:03.043520 tst register_a5_3_authreq.py:8: Test FAILED (6.7 sec) 11:03:03.071712 run osmo-hlr_10.42.42.2(pid=32514): ERR: Terminated: ERROR {rc=237} [trial-2373↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32514)] 11:03:03.122155 run osmo-hlr_10.42.42.2(pid=32514): stdout: | (launched: 2022-12-10_11:02:59.675829) 11:03:03.174221 run osmo-hlr_10.42.42.2(pid=32514): stderr: | 20221210110259854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110259854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110259854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110259854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110259854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110259855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110259869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110259879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110259879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110259879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:03:03.246551 run osmo-msc_10.42.42.6(pid=32522): ERR: Terminated: ERROR {rc=2} [trial-2373↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32522)] 11:03:03.297065 run osmo-msc_10.42.42.6(pid=32522): stdout: | (launched: 2022-12-10_11:03:01.768216) 11:03:03.349130 run osmo-msc_10.42.42.6(pid=32522): stderr: | 20221210110302356 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110302356 DLGLOBAL DEBUG validating counter group 0x7f78c95e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110302356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110302356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110302356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110302356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110302358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110302358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110302359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110302359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:03:03.401310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32513): Terminating (SIGTERM) 11:03:03.443057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32516): Terminating (SIGTERM) 11:03:03.485641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32521): Terminating (SIGTERM) 11:03:03.528049 --- ParallelTerminationStrategy: PID 32513 died... 11:03:03.547798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32513): Terminated: ok {rc=0} 11:03:03.594208 --- ParallelTerminationStrategy: PID 32516 died... 11:03:03.613461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32516): Terminated: ok {rc=0} 11:03:03.659910 --- ParallelTerminationStrategy: PID 32521 died... 11:03:03.679254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32521): Terminated: ok {rc=0} 11:03:03.766963 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 11:03:04.981278 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:03:04.986739 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 11:03:05.005832 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 11:03:05.034298 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 11:03:05.062140 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 11:03:05.080695 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 11:03:05.108086 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 11:03:05.618921 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 11:03:05.623960 tst handover.py:11: TEST_CONFIG: {} 11:03:05.843946 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:03:05.860225 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:03:05.884077 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:03:05.933807 tst handover.py: using MSISDN 7705 11:03:06.053641 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7705', subscriber_id=0} 11:03:06.167864 run srsepc_10.42.42.118: Starting srsepc 11:03:08.066231 run rm-remote-dir(pid=32527): Launched 11:03:08.195762 bus /sierra_2: Setting Powered False 11:03:09.265127 run rm-remote-dir(pid=32527): Terminated: ok {rc=0} 11:03:09.715201 run mk-remote-dir(pid=32528): Launched 11:03:10.896375 run mk-remote-dir(pid=32528): Terminated: ok {rc=0} 11:03:11.182710 run scp-inst-to-remote(pid=32529): Launched 11:03:13.362284 run scp-inst-to-remote(pid=32529): Terminated: ok {rc=0} 11:03:13.694753 run rm-remote-dir(pid=32531): Launched 11:03:14.874889 run rm-remote-dir(pid=32531): Terminated: ok {rc=0} 11:03:15.209724 run mk-remote-dir(pid=32532): Launched 11:03:16.390131 run mk-remote-dir(pid=32532): Terminated: ok {rc=0} 11:03:16.687728 run scp-cfg-to-remote(pid=32533): Launched 11:03:17.932232 run scp-cfg-to-remote(pid=32533): Terminated: ok {rc=0} 11:03:18.214893 run scp-db-to-remote(pid=32535): Launched 11:03:19.392544 run scp-db-to-remote(pid=32535): Terminated: ok {rc=0} 11:03:19.523206 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:03:19.829062 run patchelf(pid=32537): Launched 11:03:21.006281 run patchelf(pid=32537): Terminated: ok {rc=0} 11:03:21.136867 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:03:21.442748 run setcap-netadm(pid=32538): Launched 11:03:22.619596 run setcap-netadm(pid=32538): Terminated: ok {rc=0} 11:03:22.941126 run srsepc(pid=32539): Launched 11:03:23.056115 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:03:24.160589 run rm-remote-dir(pid=32540): Launched 11:03:24.338335 run srsepc(pid=32539): ERR: Terminated: ERROR {rc=127} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32539)] 11:03:24.473714 run srsepc(pid=32539): stdout: | (launched: 2022-12-10_11:03:22.885865) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:03:24.607560 run srsepc(pid=32539): stderr: | (launched: 2022-12-10_11:03:22.931236) | Connection to 10.42.42.116 closed. 11:03:24.741799 run srsepc(pid=32539): stdout: | (launched: 2022-12-10_11:03:22.885865) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:03:24.871053 run srsepc(pid=32539): stderr: | (launched: 2022-12-10_11:03:22.931236) | Connection to 10.42.42.116 closed. 11:03:25.024037 run rm-remote-dir(pid=32540): Terminating (SIGINT) 11:03:25.201204 run rm-remote-dir(pid=32540): Terminated: ok {rc=0} 11:03:25.330501 tst handover.py:37: ERR: Error: srsepc(pid=32539): Process ended prematurely: srsepc(pid=32539) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32539)] [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 11:03:25.340272 tst handover.py:37: Test FAILED (19.7 sec) 11:03:25.416824 run scp-back-log(pid=32541): Launched 11:03:26.494173 run scp-back-log(pid=32541): ERR: Terminated: ERROR {rc=1} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32541)] 11:03:26.554519 run scp-back-log(pid=32541): stdout: | (launched: 2022-12-10_11:03:25.387250) 11:03:26.615909 run scp-back-log(pid=32541): stderr: | (launched: 2022-12-10_11:03:25.406997) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:03:26.685397 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32541): launch_sync(): local process exited with status 1 [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32541)]') ---------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 11:03:26.730521 tst iperf3_bidir.py:13: Number of physical ue: 1 11:03:26.936781 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:03:26.978466 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 11:03:27.181795 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:03:27.197528 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:03:27.230309 tst iperf3_bidir.py: using MSISDN 7706 11:03:27.341449 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7706', subscriber_id=0} 11:03:27.447826 run srsepc_10.42.42.118: Starting srsepc 11:03:28.075890 run rm-remote-dir(pid=32543): Launched 11:03:29.256235 run rm-remote-dir(pid=32543): Terminated: ok {rc=0} 11:03:29.591258 run mk-remote-dir(pid=32544): Launched 11:03:30.771095 run mk-remote-dir(pid=32544): Terminated: ok {rc=0} 11:03:31.132081 run scp-inst-to-remote(pid=32545): Launched 11:03:33.374954 run scp-inst-to-remote(pid=32545): Terminated: ok {rc=0} 11:03:33.730842 run rm-remote-dir(pid=32547): Launched 11:03:34.920830 run rm-remote-dir(pid=32547): Terminated: ok {rc=0} 11:03:35.279256 run mk-remote-dir(pid=32548): Launched 11:03:36.470163 run mk-remote-dir(pid=32548): Terminated: ok {rc=0} 11:03:36.774374 run scp-cfg-to-remote(pid=32549): Launched 11:03:37.961826 run scp-cfg-to-remote(pid=32549): Terminated: ok {rc=0} 11:03:38.266269 run scp-db-to-remote(pid=32551): Launched 11:03:39.454732 run scp-db-to-remote(pid=32551): Terminated: ok {rc=0} 11:03:39.595106 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:03:39.923341 run patchelf(pid=32553): Launched 11:03:41.112027 run patchelf(pid=32553): Terminated: ok {rc=0} 11:03:41.252442 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:03:41.580816 run setcap-netadm(pid=32555): Launched 11:03:42.768829 run setcap-netadm(pid=32555): Terminated: ok {rc=0} 11:03:43.113437 run srsepc(pid=32556): Launched 11:03:43.234976 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:03:44.350952 run rm-remote-dir(pid=32557): Launched 11:03:44.528217 run srsepc(pid=32556): ERR: Terminated: ERROR {rc=127} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32556)] 11:03:44.663301 run srsepc(pid=32556): stdout: | (launched: 2022-12-10_11:03:43.054252) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:03:44.797272 run srsepc(pid=32556): stderr: | (launched: 2022-12-10_11:03:43.102946) | Connection to 10.42.42.116 closed. 11:03:44.931667 run srsepc(pid=32556): stdout: | (launched: 2022-12-10_11:03:43.054252) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:03:45.060356 run srsepc(pid=32556): stderr: | (launched: 2022-12-10_11:03:43.102946) | Connection to 10.42.42.116 closed. 11:03:45.213121 run rm-remote-dir(pid=32557): Terminating (SIGINT) 11:03:45.389783 run rm-remote-dir(pid=32557): Terminated: ok {rc=0} 11:03:45.517878 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=32556): Process ended prematurely: srsepc(pid=32556) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32556)] [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 11:03:45.527671 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 11:03:45.603537 run scp-back-log(pid=32558): Launched 11:03:46.683239 run scp-back-log(pid=32558): ERR: Terminated: ERROR {rc=1} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32558)] 11:03:46.757733 run scp-back-log(pid=32558): stdout: | (launched: 2022-12-10_11:03:45.574031) 11:03:46.835930 run scp-back-log(pid=32558): stderr: | (launched: 2022-12-10_11:03:45.593746) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:03:46.923407 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32558): launch_sync(): local process exited with status 1 [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32558)]') ---------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 11:03:46.979013 tst iperf3_dl.py:13: Number of physical ue: 1 11:03:47.234230 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:03:47.281247 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 11:03:47.484353 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:03:47.500213 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:03:47.530900 tst iperf3_dl.py: using MSISDN 7707 11:03:47.642845 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7707', subscriber_id=0} 11:03:47.749121 run srsepc_10.42.42.118: Starting srsepc 11:03:48.373197 run rm-remote-dir(pid=32560): Launched 11:03:49.553505 run rm-remote-dir(pid=32560): Terminated: ok {rc=0} 11:03:49.887660 run mk-remote-dir(pid=32561): Launched 11:03:51.067057 run mk-remote-dir(pid=32561): Terminated: ok {rc=0} 11:03:51.351984 run scp-inst-to-remote(pid=32562): Launched 11:03:53.531332 run scp-inst-to-remote(pid=32562): Terminated: ok {rc=0} 11:03:53.864479 run rm-remote-dir(pid=32564): Launched 11:03:55.043909 run rm-remote-dir(pid=32564): Terminated: ok {rc=0} 11:03:55.377908 run mk-remote-dir(pid=32565): Launched 11:03:56.557525 run mk-remote-dir(pid=32565): Terminated: ok {rc=0} 11:03:56.843165 run scp-cfg-to-remote(pid=32566): Launched 11:03:58.020020 run scp-cfg-to-remote(pid=32566): Terminated: ok {rc=0} 11:03:58.302380 run scp-db-to-remote(pid=32568): Launched 11:03:59.479824 run scp-db-to-remote(pid=32568): Terminated: ok {rc=0} 11:03:59.610943 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:03:59.916682 run patchelf(pid=32570): Launched 11:04:01.107532 run patchelf(pid=32570): Terminated: ok {rc=0} 11:04:01.283577 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:04:01.682349 run setcap-netadm(pid=32571): Launched 11:04:02.941213 run setcap-netadm(pid=32571): Terminated: ok {rc=0} 11:04:03.262704 run srsepc(pid=32572): Launched 11:04:03.377699 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:04:04.485202 run rm-remote-dir(pid=32573): Launched 11:04:04.662436 run srsepc(pid=32572): ERR: Terminated: ERROR {rc=127} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32572)] 11:04:04.797374 run srsepc(pid=32572): stdout: | (launched: 2022-12-10_11:04:03.207208) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:04:04.931587 run srsepc(pid=32572): stderr: | (launched: 2022-12-10_11:04:03.252671) | Connection to 10.42.42.116 closed. 11:04:05.066322 run srsepc(pid=32572): stdout: | (launched: 2022-12-10_11:04:03.207208) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:04:05.195533 run srsepc(pid=32572): stderr: | (launched: 2022-12-10_11:04:03.252671) | Connection to 10.42.42.116 closed. 11:04:05.348186 run rm-remote-dir(pid=32573): Terminating (SIGINT) 11:04:05.524629 run rm-remote-dir(pid=32573): Terminated: ok {rc=0} 11:04:05.652413 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=32572): Process ended prematurely: srsepc(pid=32572) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32572)] [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 11:04:05.662355 tst iperf3_dl.py:42: Test FAILED (18.7 sec) 11:04:05.738454 run scp-back-log(pid=32574): Launched 11:04:06.814856 run scp-back-log(pid=32574): ERR: Terminated: ERROR {rc=1} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32574)] 11:04:06.875311 run scp-back-log(pid=32574): stdout: | (launched: 2022-12-10_11:04:05.708607) 11:04:06.937284 run scp-back-log(pid=32574): stderr: | (launched: 2022-12-10_11:04:05.728320) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:04:07.006759 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32574): launch_sync(): local process exited with status 1 [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32574)]') ---------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 11:04:07.051952 tst iperf3_ul.py:13: Number of physical ue: 1 11:04:07.257643 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:04:07.299176 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 11:04:07.503514 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:04:07.519247 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:04:07.550554 tst iperf3_ul.py: using MSISDN 7708 11:04:07.662601 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7708', subscriber_id=0} 11:04:07.768482 run srsepc_10.42.42.118: Starting srsepc 11:04:08.394979 run rm-remote-dir(pid=32576): Launched 11:04:09.575202 run rm-remote-dir(pid=32576): Terminated: ok {rc=0} 11:04:09.910101 run mk-remote-dir(pid=32577): Launched 11:04:11.089881 run mk-remote-dir(pid=32577): Terminated: ok {rc=0} 11:04:11.376101 run scp-inst-to-remote(pid=32578): Launched 11:04:13.559443 run scp-inst-to-remote(pid=32578): Terminated: ok {rc=0} 11:04:13.914217 run rm-remote-dir(pid=32580): Launched 11:04:15.105501 run rm-remote-dir(pid=32580): Terminated: ok {rc=0} 11:04:15.463545 run mk-remote-dir(pid=32581): Launched 11:04:16.654753 run mk-remote-dir(pid=32581): Terminated: ok {rc=0} 11:04:16.958919 run scp-cfg-to-remote(pid=32582): Launched 11:04:18.195368 run scp-cfg-to-remote(pid=32582): Terminated: ok {rc=0} 11:04:18.480395 run scp-db-to-remote(pid=32584): Launched 11:04:19.658633 run scp-db-to-remote(pid=32584): Terminated: ok {rc=0} 11:04:19.789429 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:04:20.097406 run patchelf(pid=32586): Launched 11:04:21.275799 run patchelf(pid=32586): Terminated: ok {rc=0} 11:04:21.407981 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:04:21.716350 run setcap-netadm(pid=32587): Launched 11:04:22.894150 run setcap-netadm(pid=32587): Terminated: ok {rc=0} 11:04:23.218245 run srsepc(pid=32588): Launched 11:04:23.333585 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:04:24.443936 run rm-remote-dir(pid=32589): Launched 11:04:24.622858 run srsepc(pid=32588): ERR: Terminated: ERROR {rc=127} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32588)] 11:04:24.758640 run srsepc(pid=32588): stdout: | (launched: 2022-12-10_11:04:23.162126) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:04:24.893742 run srsepc(pid=32588): stderr: | (launched: 2022-12-10_11:04:23.207910) | Connection to 10.42.42.116 closed. 11:04:25.028534 run srsepc(pid=32588): stdout: | (launched: 2022-12-10_11:04:23.162126) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:04:25.158448 run srsepc(pid=32588): stderr: | (launched: 2022-12-10_11:04:23.207910) | Connection to 10.42.42.116 closed. 11:04:25.312702 run rm-remote-dir(pid=32589): Terminating (SIGINT) 11:04:25.490214 run rm-remote-dir(pid=32589): Terminated: ok {rc=0} 11:04:25.618831 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=32588): Process ended prematurely: srsepc(pid=32588) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32588)] [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 11:04:25.628686 tst iperf3_ul.py:42: Test FAILED (18.6 sec) 11:04:25.704653 run scp-back-log(pid=32590): Launched 11:04:26.781839 run scp-back-log(pid=32590): ERR: Terminated: ERROR {rc=1} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32590)] 11:04:26.841935 run scp-back-log(pid=32590): stdout: | (launched: 2022-12-10_11:04:25.674969) 11:04:26.904069 run scp-back-log(pid=32590): stderr: | (launched: 2022-12-10_11:04:25.694656) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:04:26.973875 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32590): launch_sync(): local process exited with status 1 [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32590)]') ---------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 11:04:27.019243 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:04:27.035689 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:04:27.058562 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:04:27.106019 tst ping.py: using MSISDN 7709 11:04:27.220538 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7709', subscriber_id=0} 11:04:27.327733 run srsepc_10.42.42.118: Starting srsepc 11:04:27.956598 run rm-remote-dir(pid=32592): Launched 11:04:29.135643 run rm-remote-dir(pid=32592): Terminated: ok {rc=0} 11:04:29.472185 run mk-remote-dir(pid=32593): Launched 11:04:30.651908 run mk-remote-dir(pid=32593): Terminated: ok {rc=0} 11:04:30.975862 run scp-inst-to-remote(pid=32594): Launched 11:04:33.236130 run scp-inst-to-remote(pid=32594): Terminated: ok {rc=0} 11:04:33.569641 run rm-remote-dir(pid=32596): Launched 11:04:34.750857 run rm-remote-dir(pid=32596): Terminated: ok {rc=0} 11:04:35.085670 run mk-remote-dir(pid=32597): Launched 11:04:36.266376 run mk-remote-dir(pid=32597): Terminated: ok {rc=0} 11:04:36.552741 run scp-cfg-to-remote(pid=32598): Launched 11:04:37.730072 run scp-cfg-to-remote(pid=32598): Terminated: ok {rc=0} 11:04:38.013149 run scp-db-to-remote(pid=32600): Launched 11:04:39.194035 run scp-db-to-remote(pid=32600): Terminated: ok {rc=0} 11:04:39.325630 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:04:39.632610 run patchelf(pid=32602): Launched 11:04:40.810288 run patchelf(pid=32602): Terminated: ok {rc=0} 11:04:40.941130 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:04:41.247950 run setcap-netadm(pid=32603): Launched 11:04:42.425749 run setcap-netadm(pid=32603): Terminated: ok {rc=0} 11:04:42.747414 run srsepc(pid=32604): Launched 11:04:42.862407 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:04:44.033921 run rm-remote-dir(pid=32605): Launched 11:04:44.221480 run srsepc(pid=32604): ERR: Terminated: ERROR {rc=127} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32604)] 11:04:44.365457 run srsepc(pid=32604): stdout: | (launched: 2022-12-10_11:04:42.691696) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:04:44.510042 run srsepc(pid=32604): stderr: | (launched: 2022-12-10_11:04:42.737339) | Connection to 10.42.42.116 closed. 11:04:44.654023 run srsepc(pid=32604): stdout: | (launched: 2022-12-10_11:04:42.691696) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:04:44.792850 run srsepc(pid=32604): stderr: | (launched: 2022-12-10_11:04:42.737339) | Connection to 10.42.42.116 closed. 11:04:44.956698 run rm-remote-dir(pid=32605): Terminating (SIGINT) 11:04:45.146539 run rm-remote-dir(pid=32605): Terminated: ok {rc=0} 11:04:45.284140 tst ping.py:16: ERR: Error: srsepc(pid=32604): Process ended prematurely: srsepc(pid=32604) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32604)] [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 11:04:45.295072 tst ping.py:16: Test FAILED (18.3 sec) 11:04:45.376535 run scp-back-log(pid=32606): Launched 11:04:46.454605 run scp-back-log(pid=32606): ERR: Terminated: ERROR {rc=1} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32606)] 11:04:46.520457 run scp-back-log(pid=32606): stdout: | (launched: 2022-12-10_11:04:45.345615) 11:04:46.588856 run scp-back-log(pid=32606): stderr: | (launched: 2022-12-10_11:04:45.366372) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:04:46.664688 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32606): launch_sync(): local process exited with status 1 [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32606)]') ---------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 11:04:46.715660 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:04:46.734116 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:04:46.761690 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:04:46.813961 tst rrc_idle_mo_ping.py: using MSISDN 7710 11:04:46.965291 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7710', subscriber_id=0} 11:04:47.084178 run srsepc_10.42.42.118: Starting srsepc 11:04:47.756778 run rm-remote-dir(pid=32608): Launched 11:04:48.947399 run rm-remote-dir(pid=32608): Terminated: ok {rc=0} 11:04:49.304069 run mk-remote-dir(pid=32609): Launched 11:04:50.495199 run mk-remote-dir(pid=32609): Terminated: ok {rc=0} 11:04:50.799496 run scp-inst-to-remote(pid=32610): Launched 11:04:52.988518 run scp-inst-to-remote(pid=32610): Terminated: ok {rc=0} 11:04:53.343847 run rm-remote-dir(pid=32612): Launched 11:04:54.534114 run rm-remote-dir(pid=32612): Terminated: ok {rc=0} 11:04:54.891413 run mk-remote-dir(pid=32613): Launched 11:04:56.081476 run mk-remote-dir(pid=32613): Terminated: ok {rc=0} 11:04:56.385963 run scp-cfg-to-remote(pid=32614): Launched 11:04:57.571407 run scp-cfg-to-remote(pid=32614): Terminated: ok {rc=0} 11:04:57.873022 run scp-db-to-remote(pid=32616): Launched 11:04:59.061461 run scp-db-to-remote(pid=32616): Terminated: ok {rc=0} 11:04:59.201644 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:04:59.530045 run patchelf(pid=32618): Launched 11:05:00.717188 run patchelf(pid=32618): Terminated: ok {rc=0} 11:05:00.858607 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:05:01.201975 run setcap-netadm(pid=32619): Launched 11:05:02.439328 run setcap-netadm(pid=32619): Terminated: ok {rc=0} 11:05:02.762468 run srsepc(pid=32623): Launched 11:05:02.877547 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:05:03.988664 run rm-remote-dir(pid=32624): Launched 11:05:04.167602 run srsepc(pid=32623): ERR: Terminated: ERROR {rc=127} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32623)] 11:05:04.303002 run srsepc(pid=32623): stdout: | (launched: 2022-12-10_11:05:02.707020) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:05:04.437764 run srsepc(pid=32623): stderr: | (launched: 2022-12-10_11:05:02.752425) | Connection to 10.42.42.116 closed. 11:05:04.571872 run srsepc(pid=32623): stdout: | (launched: 2022-12-10_11:05:02.707020) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:05:04.700634 run srsepc(pid=32623): stderr: | (launched: 2022-12-10_11:05:02.752425) | Connection to 10.42.42.116 closed. 11:05:04.853640 run rm-remote-dir(pid=32624): Terminating (SIGINT) 11:05:05.031315 run rm-remote-dir(pid=32624): Terminated: ok {rc=0} 11:05:05.160100 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=32623): Process ended prematurely: srsepc(pid=32623) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32623)] [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 11:05:05.170034 tst rrc_idle_mo_ping.py:16: Test FAILED (18.4 sec) 11:05:05.246385 run scp-back-log(pid=32625): Launched 11:05:06.323726 run scp-back-log(pid=32625): ERR: Terminated: ERROR {rc=1} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32625)] 11:05:06.384093 run scp-back-log(pid=32625): stdout: | (launched: 2022-12-10_11:05:05.216597) 11:05:06.446606 run scp-back-log(pid=32625): stderr: | (launched: 2022-12-10_11:05:05.236357) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:05:06.516626 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32625): launch_sync(): local process exited with status 1 [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32625)]') ---------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 11:05:06.562499 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 11:05:06.579063 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 11:05:06.601789 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 11:05:06.649272 tst rrc_idle_mt_ping.py: using MSISDN 7711 11:05:06.763813 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7711', subscriber_id=0} 11:05:06.871148 run srsepc_10.42.42.118: Starting srsepc 11:05:07.497955 run rm-remote-dir(pid=32627): Launched 11:05:08.678059 run rm-remote-dir(pid=32627): Terminated: ok {rc=0} 11:05:09.013424 run mk-remote-dir(pid=32628): Launched 11:05:10.193537 run mk-remote-dir(pid=32628): Terminated: ok {rc=0} 11:05:10.479570 run scp-inst-to-remote(pid=32629): Launched 11:05:12.657839 run scp-inst-to-remote(pid=32629): Terminated: ok {rc=0} 11:05:12.990842 run rm-remote-dir(pid=32631): Launched 11:05:14.170668 run rm-remote-dir(pid=32631): Terminated: ok {rc=0} 11:05:14.506031 run mk-remote-dir(pid=32632): Launched 11:05:15.689946 run mk-remote-dir(pid=32632): Terminated: ok {rc=0} 11:05:16.003829 run scp-cfg-to-remote(pid=32633): Launched 11:05:17.196703 run scp-cfg-to-remote(pid=32633): Terminated: ok {rc=0} 11:05:17.505206 run scp-db-to-remote(pid=32635): Launched 11:05:18.694101 run scp-db-to-remote(pid=32635): Terminated: ok {rc=0} 11:05:18.834632 run srsepc_10.42.42.118: Setting RPATH for srsepc 11:05:19.163785 run patchelf(pid=32637): Launched 11:05:20.351425 run patchelf(pid=32637): Terminated: ok {rc=0} 11:05:20.492574 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 11:05:20.821733 run setcap-netadm(pid=32638): Launched 11:05:22.010635 run setcap-netadm(pid=32638): Terminated: ok {rc=0} 11:05:22.355705 run srsepc(pid=32639): Launched 11:05:22.477107 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 11:05:23.654732 run rm-remote-dir(pid=32640): Launched 11:05:23.842480 run srsepc(pid=32639): ERR: Terminated: ERROR {rc=127} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32639)] 11:05:23.985539 run srsepc(pid=32639): stdout: | (launched: 2022-12-10_11:05:22.296809) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:05:24.129046 run srsepc(pid=32639): stderr: | (launched: 2022-12-10_11:05:22.345571) | Connection to 10.42.42.116 closed. 11:05:24.272439 run srsepc(pid=32639): stdout: | (launched: 2022-12-10_11:05:22.296809) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 11:05:24.411446 run srsepc(pid=32639): stderr: | (launched: 2022-12-10_11:05:22.345571) | Connection to 10.42.42.116 closed. 11:05:24.575401 run rm-remote-dir(pid=32640): Terminating (SIGINT) 11:05:24.764800 run rm-remote-dir(pid=32640): Terminated: ok {rc=0} 11:05:24.902709 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=32639): Process ended prematurely: srsepc(pid=32639) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32639)] [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 11:05:24.913450 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 11:05:24.993620 run scp-back-log(pid=32641): Launched 11:05:26.074515 run scp-back-log(pid=32641): ERR: Terminated: ERROR {rc=1} [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32641)] 11:05:26.138529 run scp-back-log(pid=32641): stdout: | (launched: 2022-12-10_11:05:24.962774) 11:05:26.203899 run scp-back-log(pid=32641): stderr: | (launched: 2022-12-10_11:05:24.983433) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 11:05:26.277298 tst srsepc_10.42.42.118: Error('scp-back-log(pid=32641): launch_sync(): local process exited with status 1 [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=32641)]') --------------------------------------------------------------------- trial-2373 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 11:05:26.412451 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:26.418233 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 11:05:26.461502 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 11:05:26.489226 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 11:05:26.543444 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 11:05:26.587028 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 11:05:26.614225 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 11:05:27.167597 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 11:05:27.174226 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:05:27.185963 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:05:27.225403 tst handover.py: using LAC 27946 11:05:27.353127 tst handover.py: using RAC 151 11:05:27.478813 tst handover.py: using CellId 27946 11:05:27.606881 tst handover.py: using BVCI 27947 11:05:27.724366 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 11:05:27.758446 tst handover.py: using LAC 27947 11:05:27.883342 tst handover.py: using RAC 152 11:05:28.009107 tst handover.py: using CellId 27947 11:05:28.134067 tst handover.py: using BVCI 27948 11:05:28.251368 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:05:28.262680 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:05:28.273779 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:05:28.285168 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:05:28.296538 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 11:05:28.307884 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:05:28.429768 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 11:05:28.549115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:29.018010 run create_hlr_db(pid=32648): Launched 11:05:30.187756 run create_hlr_db(pid=32648): Terminated: ok {rc=0} 11:05:30.505676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32650): Launched 11:05:30.807013 run osmo-hlr_10.42.42.2(pid=32651): Launched 11:05:31.019641 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:31.663748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32653): Launched 11:05:32.011029 run osmo-stp_10.42.42.5(pid=32654): Launched 11:05:32.275397 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:32.862987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32656): Launched 11:05:33.185336 run osmo-msc_10.42.42.6(pid=32657): Launched 11:05:33.366296 run osmo-stp_10.42.42.5(pid=32654): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32654)] 11:05:33.502785 run osmo-stp_10.42.42.5(pid=32654): stdout: | (launched: 2022-12-10_11:05:31.946418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:33.640121 run osmo-stp_10.42.42.5(pid=32654): stderr: | 20221210110532253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110532253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110532254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110532254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110532256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110532257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110532257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:33.777064 run osmo-stp_10.42.42.5(pid=32654): stdout: | (launched: 2022-12-10_11:05:31.946418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:33.905746 run osmo-stp_10.42.42.5(pid=32654): stderr: | 20221210110532253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110532253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110532254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110532254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110532256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110532257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110532257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:34.059487 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32654): Process ended prematurely: osmo-stp_10.42.42.5(pid=32654) [trial-2373↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32654)] [trial-2373↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 11:05:34.068187 tst handover.py:18: Test FAILED (6.9 sec) 11:05:34.096259 run osmo-hlr_10.42.42.2(pid=32651): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32651)] 11:05:34.146661 run osmo-hlr_10.42.42.2(pid=32651): stdout: | (launched: 2022-12-10_11:05:30.752362) 11:05:34.198962 run osmo-hlr_10.42.42.2(pid=32651): stderr: | 20221210110530930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110530930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110530930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110530930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110530930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110530930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110530947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110530963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110530963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110530963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:34.271933 run osmo-msc_10.42.42.6(pid=32657): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32657)] 11:05:34.322553 run osmo-msc_10.42.42.6(pid=32657): stdout: | (launched: 2022-12-10_11:05:33.127412) 11:05:34.375426 run osmo-msc_10.42.42.6(pid=32657): stderr: | 20221210110533447 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110533447 DLGLOBAL DEBUG validating counter group 0x7fef49169c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110533447 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110533447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110533447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110533447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110533449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110533449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110533449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110533450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:34.428122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32650): Terminating (SIGTERM) 11:05:34.470268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32653): Terminating (SIGTERM) 11:05:34.512384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32656): Terminating (SIGTERM) 11:05:34.554962 --- ParallelTerminationStrategy: PID 32650 died... 11:05:34.574957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32650): Terminated: ok {rc=0} 11:05:34.621268 --- ParallelTerminationStrategy: PID 32653 died... 11:05:34.640551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32653): Terminated: ok {rc=0} 11:05:34.686648 --- ParallelTerminationStrategy: PID 32656 died... 11:05:34.706036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32656): Terminated: ok {rc=0} 11:05:34.794451 bus /sierra_3: Setting Powered False 11:05:35.893097 bus /sierra_3: Setting Powered False 11:05:37.009605 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 11:05:38.255044 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:38.260807 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:05:38.302684 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:05:38.330285 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:05:38.383236 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:05:38.424283 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:05:38.451717 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:05:39.006706 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 11:05:39.012141 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:05:39.023408 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:05:39.065557 tst handover.py: using LAC 27948 11:05:39.187410 tst handover.py: using RAC 153 11:05:39.304936 tst handover.py: using CellId 27948 11:05:39.425198 tst handover.py: using BVCI 27949 11:05:39.535054 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 11:05:39.568062 tst handover.py: using LAC 27949 11:05:39.685359 tst handover.py: using RAC 154 11:05:39.801712 tst handover.py: using CellId 27949 11:05:39.918420 tst handover.py: using BVCI 27950 11:05:40.036367 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:05:40.047705 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:05:40.058784 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:05:40.070527 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:05:40.082601 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:05:40.094338 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:05:40.213400 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 11:05:40.328001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:40.769507 run create_hlr_db(pid=32662): Launched 11:05:40.884483 bus /sierra_2: Setting Powered False 11:05:41.943807 run create_hlr_db(pid=32662): Terminated: ok {rc=0} 11:05:42.356742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32664): Launched 11:05:42.679726 run osmo-hlr_10.42.42.2(pid=32665): Launched 11:05:42.803228 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:43.330144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32667): Launched 11:05:43.653014 run osmo-stp_10.42.42.5(pid=32668): Launched 11:05:43.776711 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:44.333205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32670): Launched 11:05:44.656445 run osmo-msc_10.42.42.6(pid=32671): Launched 11:05:44.836857 run osmo-stp_10.42.42.5(pid=32668): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32668)] 11:05:44.973220 run osmo-stp_10.42.42.5(pid=32668): stdout: | (launched: 2022-12-10_11:05:43.595043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:45.110316 run osmo-stp_10.42.42.5(pid=32668): stderr: | 20221210110543788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110543788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110543788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110543789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110543789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110543789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110543789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:45.245714 run osmo-stp_10.42.42.5(pid=32668): stdout: | (launched: 2022-12-10_11:05:43.595043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:45.376045 run osmo-stp_10.42.42.5(pid=32668): stderr: | 20221210110543788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110543788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110543788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110543789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110543789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110543789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110543789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:45.530057 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32668): Process ended prematurely: osmo-stp_10.42.42.5(pid=32668) [trial-2373↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32668)] [trial-2373↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 11:05:45.538822 tst handover.py:18: Test FAILED (6.5 sec) 11:05:45.566636 run osmo-hlr_10.42.42.2(pid=32665): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32665)] 11:05:45.616560 run osmo-hlr_10.42.42.2(pid=32665): stdout: | (launched: 2022-12-10_11:05:42.622051) 11:05:45.668330 run osmo-hlr_10.42.42.2(pid=32665): stderr: | 20221210110542820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110542820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110542820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110542820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110542820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110542820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110542832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110542840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110542841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110542841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:45.740589 run osmo-msc_10.42.42.6(pid=32671): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32671)] 11:05:45.790594 run osmo-msc_10.42.42.6(pid=32671): stdout: | (launched: 2022-12-10_11:05:44.598595) 11:05:45.843909 run osmo-msc_10.42.42.6(pid=32671): stderr: | 20221210110544918 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110544918 DLGLOBAL DEBUG validating counter group 0x7f6538c32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110544918 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110544918 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110544918 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110544919 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110544920 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110544921 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110544921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110544921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:45.901765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32664): Terminating (SIGTERM) 11:05:45.944270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32667): Terminating (SIGTERM) 11:05:45.987419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32670): Terminating (SIGTERM) 11:05:46.031569 --- ParallelTerminationStrategy: PID 32664 died... 11:05:46.051631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32664): Terminated: ok {rc=0} 11:05:46.098809 --- ParallelTerminationStrategy: PID 32667 died... 11:05:46.118825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32667): Terminated: ok {rc=0} 11:05:46.165841 --- ParallelTerminationStrategy: PID 32670 died... 11:05:46.185844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32670): Terminated: ok {rc=0} 11:05:46.274035 bus /sierra_3: Setting Powered False 11:05:47.370280 bus /sierra_3: Setting Powered False 11:05:48.486153 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 11:05:49.729415 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:05:49.734521 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:05:49.788395 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:05:49.815515 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:05:49.867398 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:05:49.920123 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:05:49.946500 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:05:50.497586 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 11:05:50.502912 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:05:50.513915 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:05:50.552338 tst handover.py: using LAC 27950 11:05:50.676070 tst handover.py: using RAC 155 11:05:50.795069 tst handover.py: using CellId 27950 11:05:50.912264 tst handover.py: using BVCI 27951 11:05:51.021983 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:05:51.073402 tst handover.py: using LAC 27951 11:05:51.192250 tst handover.py: using RAC 156 11:05:51.309385 tst handover.py: using CellId 27951 11:05:51.427578 tst handover.py: using BVCI 27952 11:05:51.537540 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:05:51.548377 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:05:51.559169 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:05:51.570482 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:05:51.581774 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:05:51.592896 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:05:51.710808 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:05:51.825560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:05:52.297494 run create_hlr_db(pid=32676): Launched 11:05:52.429765 bus /sierra_2: Setting Powered False 11:05:53.493375 run create_hlr_db(pid=32676): Terminated: ok {rc=0} 11:05:53.899236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32678): Launched 11:05:54.201683 run osmo-hlr_10.42.42.2(pid=32679): Launched 11:05:54.317636 run osmo-stp_10.42.42.5: Starting osmo-stp 11:05:54.809805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32681): Launched 11:05:55.110593 run osmo-stp_10.42.42.5(pid=32682): Launched 11:05:55.226474 run osmo-msc_10.42.42.6: Starting osmo-msc 11:05:55.746741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32684): Launched 11:05:56.049540 run osmo-msc_10.42.42.6(pid=32685): Launched 11:05:56.219711 run osmo-stp_10.42.42.5(pid=32682): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32682)] 11:05:56.348634 run osmo-stp_10.42.42.5(pid=32682): stdout: | (launched: 2022-12-10_11:05:55.056414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:56.477298 run osmo-stp_10.42.42.5(pid=32682): stderr: | 20221210110555224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110555224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110555225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110555225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110555226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110555226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110555226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:56.603408 run osmo-stp_10.42.42.5(pid=32682): stdout: | (launched: 2022-12-10_11:05:55.056414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:05:56.723919 run osmo-stp_10.42.42.5(pid=32682): stderr: | 20221210110555224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110555224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110555225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110555225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110555226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110555226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110555226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:05:56.868127 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32682): Process ended prematurely: osmo-stp_10.42.42.5(pid=32682) [trial-2373↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32682)] [trial-2373↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 11:05:56.876304 tst handover.py:18: Test FAILED (6.4 sec) 11:05:56.902693 run osmo-hlr_10.42.42.2(pid=32679): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32679)] 11:05:56.950227 run osmo-hlr_10.42.42.2(pid=32679): stdout: | (launched: 2022-12-10_11:05:54.146599) 11:05:56.999714 run osmo-hlr_10.42.42.2(pid=32679): stderr: | 20221210110554323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110554324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110554324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110554324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110554324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110554324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110554336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110554347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110554347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110554347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:05:57.068467 run osmo-msc_10.42.42.6(pid=32685): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32685)] 11:05:57.115954 run osmo-msc_10.42.42.6(pid=32685): stdout: | (launched: 2022-12-10_11:05:55.994912) 11:05:57.165024 run osmo-msc_10.42.42.6(pid=32685): stderr: | 20221210110556263 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110556263 DLGLOBAL DEBUG validating counter group 0x7f293b6a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110556263 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110556263 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110556263 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110556263 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110556267 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110556267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110556267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110556267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:05:57.214745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32678): Terminating (SIGTERM) 11:05:57.254588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32681): Terminating (SIGTERM) 11:05:57.294655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32684): Terminating (SIGTERM) 11:05:57.334871 --- ParallelTerminationStrategy: PID 32678 died... 11:05:57.353814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32678): Terminated: ok {rc=0} 11:05:57.398286 --- ParallelTerminationStrategy: PID 32681 died... 11:05:57.416665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32681): Terminated: ok {rc=0} 11:05:57.461153 --- ParallelTerminationStrategy: PID 32684 died... 11:05:57.479656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32684): Terminated: ok {rc=0} 11:05:57.565249 bus /sierra_3: Setting Powered False 11:05:58.663690 bus /sierra_3: Setting Powered False 11:05:59.780929 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:06:01.063591 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:01.070411 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:06:01.134554 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:06:01.168793 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:06:01.238814 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:06:01.291780 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:06:01.319927 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:06:01.892038 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:06:01.897919 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:06:01.909741 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:06:01.952127 tst handover.py: using LAC 27952 11:06:02.080308 tst handover.py: using RAC 157 11:06:02.208076 tst handover.py: using CellId 27952 11:06:02.331830 tst handover.py: using BVCI 27953 11:06:02.449726 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:06:02.495987 tst handover.py: using LAC 27953 11:06:02.624221 tst handover.py: using RAC 158 11:06:02.751259 tst handover.py: using CellId 27953 11:06:02.872139 tst handover.py: using BVCI 27954 11:06:02.982434 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:06:02.994043 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:06:03.005211 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:06:03.016476 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:06:03.027744 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:06:03.038813 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:06:03.155859 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:06:03.275653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:03.747188 run create_hlr_db(pid=32690): Launched 11:06:03.878249 bus /sierra_2: Setting Powered False 11:06:04.942182 run create_hlr_db(pid=32690): Terminated: ok {rc=0} 11:06:05.348683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32692): Launched 11:06:05.651960 run osmo-hlr_10.42.42.2(pid=32693): Launched 11:06:05.768326 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:06.278903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32695): Launched 11:06:06.580251 run osmo-stp_10.42.42.5(pid=32696): Launched 11:06:06.696184 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:07.219562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32698): Launched 11:06:07.522758 run osmo-msc_10.42.42.6(pid=32699): Launched 11:06:07.692217 run osmo-stp_10.42.42.5(pid=32696): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32696)] 11:06:07.819933 run osmo-stp_10.42.42.5(pid=32696): stdout: | (launched: 2022-12-10_11:06:06.525673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:07.947729 run osmo-stp_10.42.42.5(pid=32696): stderr: | 20221210110606693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110606693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110606694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110606694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110606696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110606696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110606697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:08.074813 run osmo-stp_10.42.42.5(pid=32696): stdout: | (launched: 2022-12-10_11:06:06.525673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:08.195479 run osmo-stp_10.42.42.5(pid=32696): stderr: | 20221210110606693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110606693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110606694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110606694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110606696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110606696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110606697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:08.339187 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32696): Process ended prematurely: osmo-stp_10.42.42.5(pid=32696) [trial-2373↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32696)] [trial-2373↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 11:06:08.347418 tst handover.py:18: Test FAILED (6.4 sec) 11:06:08.373860 run osmo-hlr_10.42.42.2(pid=32693): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32693)] 11:06:08.421514 run osmo-hlr_10.42.42.2(pid=32693): stdout: | (launched: 2022-12-10_11:06:05.596849) 11:06:08.471380 run osmo-hlr_10.42.42.2(pid=32693): stderr: | 20221210110605775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110605775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110605775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110605775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110605775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110605775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110605786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110605796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110605797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110605797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:08.540340 run osmo-msc_10.42.42.6(pid=32699): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32699)] 11:06:08.588456 run osmo-msc_10.42.42.6(pid=32699): stdout: | (launched: 2022-12-10_11:06:07.467923) 11:06:08.637878 run osmo-msc_10.42.42.6(pid=32699): stderr: | 20221210110607738 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110607738 DLGLOBAL DEBUG validating counter group 0x7f70a781bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110607738 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110607738 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110607738 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110607739 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110607740 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110607741 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110607741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110607741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:08.687688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32692): Terminating (SIGTERM) 11:06:08.727624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32695): Terminating (SIGTERM) 11:06:08.767483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32698): Terminating (SIGTERM) 11:06:08.807669 --- ParallelTerminationStrategy: PID 32692 died... 11:06:08.826745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32692): Terminated: ok {rc=0} 11:06:08.871227 --- ParallelTerminationStrategy: PID 32695 died... 11:06:08.889888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32695): Terminated: ok {rc=0} 11:06:08.934257 --- ParallelTerminationStrategy: PID 32698 died... 11:06:08.952710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32698): Terminated: ok {rc=0} 11:06:09.037571 bus /sierra_3: Setting Powered False 11:06:10.134707 bus /sierra_3: Setting Powered False 11:06:11.250557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:06:12.506511 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:12.511902 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:06:12.566003 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:06:12.592214 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:06:12.648114 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:06:12.701553 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:06:12.727868 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:06:13.274350 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:06:13.279407 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:06:13.290338 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:06:13.327728 tst handover.py: using LAC 27954 11:06:13.445395 tst handover.py: using RAC 159 11:06:13.561816 tst handover.py: using CellId 27954 11:06:13.682963 tst handover.py: using BVCI 27955 11:06:13.794395 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:06:13.841568 tst handover.py: using LAC 27955 11:06:13.961283 tst handover.py: using RAC 160 11:06:14.078252 tst handover.py: using CellId 27955 11:06:14.195464 tst handover.py: using BVCI 27956 11:06:14.305196 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:06:14.316035 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:06:14.326735 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:06:14.337763 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:06:14.348722 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:06:14.359711 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:06:14.478092 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:06:14.594380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:15.036876 run create_hlr_db(pid=32705): Launched 11:06:15.152339 bus /sierra_2: Setting Powered False 11:06:16.212568 run create_hlr_db(pid=32705): Terminated: ok {rc=0} 11:06:16.629456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32707): Launched 11:06:16.961804 run osmo-hlr_10.42.42.2(pid=32708): Launched 11:06:17.204479 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:17.703520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32710): Launched 11:06:18.005843 run osmo-stp_10.42.42.5(pid=32711): Launched 11:06:18.122848 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:18.644164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32713): Launched 11:06:18.967828 run osmo-msc_10.42.42.6(pid=32714): Launched 11:06:19.147853 run osmo-stp_10.42.42.5(pid=32711): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32711)] 11:06:19.283722 run osmo-stp_10.42.42.5(pid=32711): stdout: | (launched: 2022-12-10_11:06:17.951116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:19.420722 run osmo-stp_10.42.42.5(pid=32711): stderr: | 20221210110618120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110618120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110618120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110618121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110618121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110618121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110618121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:19.555719 run osmo-stp_10.42.42.5(pid=32711): stdout: | (launched: 2022-12-10_11:06:17.951116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:19.683458 run osmo-stp_10.42.42.5(pid=32711): stderr: | 20221210110618120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110618120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110618120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110618121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110618121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110618121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110618121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:19.836552 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32711): Process ended prematurely: osmo-stp_10.42.42.5(pid=32711) [trial-2373↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32711)] [trial-2373↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 11:06:19.845227 tst handover.py:18: Test FAILED (6.6 sec) 11:06:19.872314 run osmo-hlr_10.42.42.2(pid=32708): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32708)] 11:06:19.922411 run osmo-hlr_10.42.42.2(pid=32708): stdout: | (launched: 2022-12-10_11:06:16.891914) 11:06:19.973944 run osmo-hlr_10.42.42.2(pid=32708): stderr: | 20221210110617227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110617227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110617227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110617227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110617227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110617227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110617250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110617268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110617268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110617268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:20.045984 run osmo-msc_10.42.42.6(pid=32714): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32714)] 11:06:20.096331 run osmo-msc_10.42.42.6(pid=32714): stdout: | (launched: 2022-12-10_11:06:18.909987) 11:06:20.148283 run osmo-msc_10.42.42.6(pid=32714): stderr: | 20221210110619230 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110619230 DLGLOBAL DEBUG validating counter group 0x7f56529b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110619230 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110619230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110619230 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110619230 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110619232 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110619233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110619233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110619233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:20.200395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32707): Terminating (SIGTERM) 11:06:20.242248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32710): Terminating (SIGTERM) 11:06:20.284077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32713): Terminating (SIGTERM) 11:06:20.326265 --- ParallelTerminationStrategy: PID 32707 died... 11:06:20.346145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32707): Terminated: ok {rc=0} 11:06:20.392463 --- ParallelTerminationStrategy: PID 32710 died... 11:06:20.411875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32710): Terminated: ok {rc=0} 11:06:20.458124 --- ParallelTerminationStrategy: PID 32713 died... 11:06:20.477554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32713): Terminated: ok {rc=0} 11:06:20.565634 bus /sierra_3: Setting Powered False 11:06:21.664718 bus /sierra_3: Setting Powered False 11:06:22.782094 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 11:06:24.041377 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:24.046323 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:06:24.088212 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:06:24.114698 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:06:24.166969 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:06:24.207918 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:06:24.234700 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:06:24.784244 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 11:06:24.789329 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:06:24.800236 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:06:24.840790 tst handover.py: using LAC 27956 11:06:24.959627 tst handover.py: using RAC 161 11:06:25.076776 tst handover.py: using CellId 27956 11:06:25.194530 tst handover.py: using BVCI 27957 11:06:25.304633 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 11:06:25.341950 tst handover.py: using LAC 27957 11:06:25.458252 tst handover.py: using RAC 162 11:06:25.575233 tst handover.py: using CellId 27957 11:06:25.693872 tst handover.py: using BVCI 27958 11:06:25.805298 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:06:25.816250 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:06:25.826797 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:06:25.837625 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:06:25.848503 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:06:25.859295 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:06:25.978109 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 11:06:26.094400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:26.537516 run create_hlr_db(pid=32720): Launched 11:06:26.653583 bus /sierra_2: Setting Powered False 11:06:27.713655 run create_hlr_db(pid=32720): Terminated: ok {rc=0} 11:06:28.109655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32722): Launched 11:06:28.411922 run osmo-hlr_10.42.42.2(pid=32723): Launched 11:06:28.527858 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:29.020820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32725): Launched 11:06:29.322192 run osmo-stp_10.42.42.5(pid=32726): Launched 11:06:29.438193 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:29.958219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32728): Launched 11:06:30.261376 run osmo-msc_10.42.42.6(pid=32729): Launched 11:06:30.431195 run osmo-stp_10.42.42.5(pid=32726): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32726)] 11:06:30.560511 run osmo-stp_10.42.42.5(pid=32726): stdout: | (launched: 2022-12-10_11:06:29.267714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:30.689792 run osmo-stp_10.42.42.5(pid=32726): stderr: | 20221210110629437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110629437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110629437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110629437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110629438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110629438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110629438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:30.816067 run osmo-stp_10.42.42.5(pid=32726): stdout: | (launched: 2022-12-10_11:06:29.267714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:30.947827 run osmo-stp_10.42.42.5(pid=32726): stderr: | 20221210110629437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110629437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110629437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110629437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110629438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110629438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110629438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:31.096337 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32726): Process ended prematurely: osmo-stp_10.42.42.5(pid=32726) [trial-2373↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32726)] [trial-2373↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 11:06:31.105442 tst handover.py:18: Test FAILED (6.3 sec) 11:06:31.134409 run osmo-hlr_10.42.42.2(pid=32723): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32723)] 11:06:31.184725 run osmo-hlr_10.42.42.2(pid=32723): stdout: | (launched: 2022-12-10_11:06:28.357419) 11:06:31.236554 run osmo-hlr_10.42.42.2(pid=32723): stderr: | 20221210110628530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110628530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110628530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110628531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110628531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110628531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110628546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110628554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110628554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110628555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:31.308291 run osmo-msc_10.42.42.6(pid=32729): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32729)] 11:06:31.358581 run osmo-msc_10.42.42.6(pid=32729): stdout: | (launched: 2022-12-10_11:06:30.206507) 11:06:31.410027 run osmo-msc_10.42.42.6(pid=32729): stderr: | 20221210110630478 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110630478 DLGLOBAL DEBUG validating counter group 0x7f6810f21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110630478 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110630478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110630479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110630479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110630481 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110630482 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110630482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110630482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:31.461983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32722): Terminating (SIGTERM) 11:06:31.503749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32725): Terminating (SIGTERM) 11:06:31.545686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32728): Terminating (SIGTERM) 11:06:31.587588 --- ParallelTerminationStrategy: PID 32722 died... 11:06:31.607047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32722): Terminated: ok {rc=0} 11:06:31.654244 --- ParallelTerminationStrategy: PID 32725 died... 11:06:31.673589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32725): Terminated: ok {rc=0} 11:06:31.720363 --- ParallelTerminationStrategy: PID 32728 died... 11:06:31.739903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32728): Terminated: ok {rc=0} 11:06:31.831097 bus /sierra_3: Setting Powered False 11:06:32.937678 bus /sierra_3: Setting Powered False 11:06:34.051184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 11:06:35.296147 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:35.301212 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:06:35.354456 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:06:35.381070 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:06:35.432407 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:06:35.485152 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:06:35.511366 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:06:36.062941 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 11:06:36.068018 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:06:36.078742 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:06:36.117254 tst handover.py: using LAC 27958 11:06:36.235674 tst handover.py: using RAC 163 11:06:36.354579 tst handover.py: using CellId 27958 11:06:36.471705 tst handover.py: using BVCI 27959 11:06:36.581301 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:06:36.629259 tst handover.py: using LAC 27959 11:06:36.748743 tst handover.py: using RAC 164 11:06:36.875320 tst handover.py: using CellId 27959 11:06:37.001349 tst handover.py: using BVCI 27960 11:06:37.119701 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:06:37.131122 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:06:37.142484 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:06:37.153766 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:06:37.164862 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:06:37.175908 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:06:37.291153 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:06:37.404604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:37.871537 run create_hlr_db(pid=32734): Launched 11:06:37.993091 bus /sierra_2: Setting Powered False 11:06:39.053685 run create_hlr_db(pid=32734): Terminated: ok {rc=0} 11:06:39.466439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32736): Launched 11:06:39.786993 run osmo-hlr_10.42.42.2(pid=32737): Launched 11:06:39.910223 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:40.442035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32739): Launched 11:06:40.762936 run osmo-stp_10.42.42.5(pid=32740): Launched 11:06:40.885307 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:41.439186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32742): Launched 11:06:41.761032 run osmo-msc_10.42.42.6(pid=32743): Launched 11:06:41.941856 run osmo-stp_10.42.42.5(pid=32740): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32740)] 11:06:42.077762 run osmo-stp_10.42.42.5(pid=32740): stdout: | (launched: 2022-12-10_11:06:40.705132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:42.213535 run osmo-stp_10.42.42.5(pid=32740): stderr: | 20221210110640897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110640897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110640897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110640898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110640898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110640898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110640898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:42.348790 run osmo-stp_10.42.42.5(pid=32740): stdout: | (launched: 2022-12-10_11:06:40.705132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:42.477592 run osmo-stp_10.42.42.5(pid=32740): stderr: | 20221210110640897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110640897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110640897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110640898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110640898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110640898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110640898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:42.631028 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32740): Process ended prematurely: osmo-stp_10.42.42.5(pid=32740) [trial-2373↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32740)] [trial-2373↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 11:06:42.639625 tst handover.py:18: Test FAILED (6.6 sec) 11:06:42.666841 run osmo-hlr_10.42.42.2(pid=32737): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32737)] 11:06:42.716523 run osmo-hlr_10.42.42.2(pid=32737): stdout: | (launched: 2022-12-10_11:06:39.729445) 11:06:42.768059 run osmo-hlr_10.42.42.2(pid=32737): stderr: | 20221210110639929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110639929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110639929 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110639929 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110639929 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110639929 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110639941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110639949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110639949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110639949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:42.839962 run osmo-msc_10.42.42.6(pid=32743): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32743)] 11:06:42.889646 run osmo-msc_10.42.42.6(pid=32743): stdout: | (launched: 2022-12-10_11:06:41.703063) 11:06:42.941171 run osmo-msc_10.42.42.6(pid=32743): stderr: | 20221210110642025 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110642025 DLGLOBAL DEBUG validating counter group 0x7f7135f5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110642025 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110642026 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110642026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110642026 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110642028 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110642028 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110642028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110642028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:42.993099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32736): Terminating (SIGTERM) 11:06:43.034501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32739): Terminating (SIGTERM) 11:06:43.076042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32742): Terminating (SIGTERM) 11:06:43.117914 --- ParallelTerminationStrategy: PID 32736 died... 11:06:43.137703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32736): Terminated: ok {rc=0} 11:06:43.183543 --- ParallelTerminationStrategy: PID 32739 died... 11:06:43.202811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32739): Terminated: ok {rc=0} 11:06:43.248392 --- ParallelTerminationStrategy: PID 32742 died... 11:06:43.267866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32742): Terminated: ok {rc=0} 11:06:43.354445 bus /sierra_3: Setting Powered False 11:06:44.451519 bus /sierra_3: Setting Powered False 11:06:45.567414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 11:06:46.862205 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:46.867967 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:06:46.928416 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:06:46.956797 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:06:47.009330 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:06:47.075412 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:06:47.110806 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:06:47.643127 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 11:06:47.648668 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:06:47.660150 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:06:47.699185 tst handover.py: using LAC 27960 11:06:47.828092 tst handover.py: using RAC 165 11:06:47.953719 tst handover.py: using CellId 27960 11:06:48.080559 tst handover.py: using BVCI 27961 11:06:48.197947 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:06:48.251666 tst handover.py: using LAC 27961 11:06:48.377549 tst handover.py: using RAC 166 11:06:48.502247 tst handover.py: using CellId 27961 11:06:48.629162 tst handover.py: using BVCI 27962 11:06:48.745769 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:06:48.757156 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:06:48.768204 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:06:48.779361 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:06:48.790636 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:06:48.801821 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:06:48.917355 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:06:49.031728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:06:49.473720 run create_hlr_db(pid=32748): Launched 11:06:49.590508 bus /sierra_2: Setting Powered False 11:06:50.650559 run create_hlr_db(pid=32748): Terminated: ok {rc=0} 11:06:51.063857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32750): Launched 11:06:51.385083 run osmo-hlr_10.42.42.2(pid=32751): Launched 11:06:51.509508 run osmo-stp_10.42.42.5: Starting osmo-stp 11:06:52.034774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32753): Launched 11:06:52.355863 run osmo-stp_10.42.42.5(pid=32754): Launched 11:06:52.479058 run osmo-msc_10.42.42.6: Starting osmo-msc 11:06:53.031728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32756): Launched 11:06:53.353416 run osmo-msc_10.42.42.6(pid=32757): Launched 11:06:53.534467 run osmo-stp_10.42.42.5(pid=32754): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32754)] 11:06:53.670250 run osmo-stp_10.42.42.5(pid=32754): stdout: | (launched: 2022-12-10_11:06:52.297888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:53.805872 run osmo-stp_10.42.42.5(pid=32754): stderr: | 20221210110652491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110652492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110652492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110652492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110652493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110652493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110652493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:53.941074 run osmo-stp_10.42.42.5(pid=32754): stdout: | (launched: 2022-12-10_11:06:52.297888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:06:54.069360 run osmo-stp_10.42.42.5(pid=32754): stderr: | 20221210110652491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110652492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110652492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110652492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110652493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110652493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110652493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:06:54.222597 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32754): Process ended prematurely: osmo-stp_10.42.42.5(pid=32754) [trial-2373↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32754)] [trial-2373↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 11:06:54.231207 tst handover.py:18: Test FAILED (6.6 sec) 11:06:54.258322 run osmo-hlr_10.42.42.2(pid=32751): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32751)] 11:06:54.307967 run osmo-hlr_10.42.42.2(pid=32751): stdout: | (launched: 2022-12-10_11:06:51.327143) 11:06:54.359834 run osmo-hlr_10.42.42.2(pid=32751): stderr: | 20221210110651525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110651525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110651525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110651525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110651525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110651525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110651537 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110651546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110651546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110651546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:06:54.432093 run osmo-msc_10.42.42.6(pid=32757): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32757)] 11:06:54.481796 run osmo-msc_10.42.42.6(pid=32757): stdout: | (launched: 2022-12-10_11:06:53.295344) 11:06:54.533266 run osmo-msc_10.42.42.6(pid=32757): stderr: | 20221210110653616 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110653616 DLGLOBAL DEBUG validating counter group 0x7f3a90d18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110653616 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110653616 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110653616 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110653617 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110653618 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110653619 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110653619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110653619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:06:54.584923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32750): Terminating (SIGTERM) 11:06:54.626335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32753): Terminating (SIGTERM) 11:06:54.667656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32756): Terminating (SIGTERM) 11:06:54.709379 --- ParallelTerminationStrategy: PID 32750 died... 11:06:54.729258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32750): Terminated: ok {rc=0} 11:06:54.775068 --- ParallelTerminationStrategy: PID 32753 died... 11:06:54.794486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32753): Terminated: ok {rc=0} 11:06:54.840323 --- ParallelTerminationStrategy: PID 32756 died... 11:06:54.859881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32756): Terminated: ok {rc=0} 11:06:54.947845 bus /sierra_3: Setting Powered False 11:06:56.046735 bus /sierra_3: Setting Powered False 11:06:57.162813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 11:06:58.420847 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:06:58.425733 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 11:06:58.462461 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 11:06:58.488862 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 11:06:58.540545 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 11:06:58.576864 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 11:06:58.603312 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 11:06:59.157772 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 11:06:59.163357 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:06:59.174865 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:06:59.210296 tst handover.py: using LAC 27962 11:06:59.336212 tst handover.py: using RAC 167 11:06:59.460416 tst handover.py: using CellId 27962 11:06:59.577352 tst handover.py: using BVCI 27963 11:06:59.686621 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 11:06:59.718821 tst handover.py: using LAC 27963 11:06:59.836313 tst handover.py: using RAC 168 11:06:59.953103 tst handover.py: using CellId 27963 11:07:00.070343 tst handover.py: using BVCI 27964 11:07:00.181396 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:07:00.191966 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:07:00.202583 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:07:00.213557 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:07:00.224308 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 11:07:00.235246 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:07:00.351226 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 11:07:00.469999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:00.943663 run create_hlr_db(pid=32762): Launched 11:07:01.092640 bus /sierra_2: Setting Powered False 11:07:02.155299 run create_hlr_db(pid=32762): Terminated: ok {rc=0} 11:07:02.583198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32764): Launched 11:07:02.905133 run osmo-hlr_10.42.42.2(pid=32765): Launched 11:07:03.028237 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:03.555187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32767): Launched 11:07:03.876838 run osmo-stp_10.42.42.5(pid=300): Launched 11:07:03.999950 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:04.557865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=302): Launched 11:07:04.880745 run osmo-msc_10.42.42.6(pid=303): Launched 11:07:05.061198 run osmo-stp_10.42.42.5(pid=300): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=300)] 11:07:05.198125 run osmo-stp_10.42.42.5(pid=300): stdout: | (launched: 2022-12-10_11:07:03.819192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:05.334929 run osmo-stp_10.42.42.5(pid=300): stderr: | 20221210110704009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110704009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110704010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110704010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110704012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110704013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110704013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:05.470860 run osmo-stp_10.42.42.5(pid=300): stdout: | (launched: 2022-12-10_11:07:03.819192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:05.599566 run osmo-stp_10.42.42.5(pid=300): stderr: | 20221210110704009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110704009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110704010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110704010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110704012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110704013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110704013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:05.754044 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=300): Process ended prematurely: osmo-stp_10.42.42.5(pid=300) [trial-2373↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=300)] [trial-2373↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 11:07:05.762762 tst handover.py:18: Test FAILED (6.6 sec) 11:07:05.789934 run osmo-hlr_10.42.42.2(pid=32765): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32765)] 11:07:05.839792 run osmo-hlr_10.42.42.2(pid=32765): stdout: | (launched: 2022-12-10_11:07:02.846816) 11:07:05.891382 run osmo-hlr_10.42.42.2(pid=32765): stderr: | 20221210110703044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110703044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110703044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110703044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110703045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110703045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110703056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110703064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110703064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110703064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:05.963587 run osmo-msc_10.42.42.6(pid=303): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=303)] 11:07:06.013502 run osmo-msc_10.42.42.6(pid=303): stdout: | (launched: 2022-12-10_11:07:04.822539) 11:07:06.065229 run osmo-msc_10.42.42.6(pid=303): stderr: | 20221210110705143 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110705144 DLGLOBAL DEBUG validating counter group 0x7fa713888c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110705144 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110705144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110705144 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110705144 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110705147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110705148 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110705148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110705148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:06.117376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32764): Terminating (SIGTERM) 11:07:06.159085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32767): Terminating (SIGTERM) 11:07:06.200989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=302): Terminating (SIGTERM) 11:07:06.243059 --- ParallelTerminationStrategy: PID 32764 died... 11:07:06.262729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32764): Terminated: ok {rc=0} 11:07:06.308875 --- ParallelTerminationStrategy: PID 32767 died... 11:07:06.328836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32767): Terminated: ok {rc=0} 11:07:06.374839 --- ParallelTerminationStrategy: PID 302 died... 11:07:06.394375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=302): Terminated: ok {rc=0} 11:07:06.482910 bus /sierra_3: Setting Powered False 11:07:07.581732 bus /sierra_3: Setting Powered False 11:07:08.698237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 11:07:09.937626 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:09.943758 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:07:09.995215 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:07:10.022493 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:07:10.074842 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:07:10.125801 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:07:10.152691 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:07:10.705895 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 11:07:10.711112 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:07:10.722405 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:07:10.757722 tst handover.py: using LAC 27964 11:07:10.884663 tst handover.py: using RAC 169 11:07:11.012634 tst handover.py: using CellId 27964 11:07:11.144330 tst handover.py: using BVCI 27965 11:07:11.262605 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:07:11.311052 tst handover.py: using LAC 27965 11:07:11.437302 tst handover.py: using RAC 170 11:07:11.562492 tst handover.py: using CellId 27965 11:07:11.686326 tst handover.py: using BVCI 27966 11:07:11.803752 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:07:11.815020 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:07:11.826099 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:07:11.837111 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:07:11.848148 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:07:11.859200 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:07:11.975484 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:07:12.095017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:12.566553 run create_hlr_db(pid=308): Launched 11:07:12.697793 bus /sierra_2: Setting Powered False 11:07:13.762086 run create_hlr_db(pid=308): Terminated: ok {rc=0} 11:07:14.183085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=310): Launched 11:07:14.505598 run osmo-hlr_10.42.42.2(pid=311): Launched 11:07:14.630010 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:15.155378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=313): Launched 11:07:15.476428 run osmo-stp_10.42.42.5(pid=314): Launched 11:07:15.599994 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:16.186478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=316): Launched 11:07:16.528810 run osmo-msc_10.42.42.6(pid=317): Launched 11:07:16.805392 run osmo-stp_10.42.42.5(pid=314): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=314)] 11:07:16.975720 run osmo-stp_10.42.42.5(pid=314): stdout: | (launched: 2022-12-10_11:07:15.418432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:17.206377 run osmo-stp_10.42.42.5(pid=314): stderr: | 20221210110715610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110715610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110715610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110715611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110715613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110715613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110715613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:17.431405 run osmo-stp_10.42.42.5(pid=314): stdout: | (launched: 2022-12-10_11:07:15.418432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:17.560143 run osmo-stp_10.42.42.5(pid=314): stderr: | 20221210110715610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110715610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110715610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110715611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110715613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110715613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110715613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:17.713576 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=314): Process ended prematurely: osmo-stp_10.42.42.5(pid=314) [trial-2373↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=314)] [trial-2373↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 11:07:17.722294 tst handover.py:18: Test FAILED (7.0 sec) 11:07:17.749523 run osmo-hlr_10.42.42.2(pid=311): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=311)] 11:07:17.799339 run osmo-hlr_10.42.42.2(pid=311): stdout: | (launched: 2022-12-10_11:07:14.447357) 11:07:17.850904 run osmo-hlr_10.42.42.2(pid=311): stderr: | 20221210110714645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110714645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110714645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110714645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110714645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110714645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110714658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110714666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110714667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110714667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:17.923004 run osmo-msc_10.42.42.6(pid=317): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=317)] 11:07:17.972766 run osmo-msc_10.42.42.6(pid=317): stdout: | (launched: 2022-12-10_11:07:16.462515) 11:07:18.024168 run osmo-msc_10.42.42.6(pid=317): stderr: | 20221210110717083 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110717084 DLGLOBAL DEBUG validating counter group 0x7f6297b72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110717084 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110717084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110717084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110717084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110717091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110717092 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110717092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110717092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:18.076079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=310): Terminating (SIGTERM) 11:07:18.117695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=313): Terminating (SIGTERM) 11:07:18.159241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=316): Terminating (SIGTERM) 11:07:18.201107 --- ParallelTerminationStrategy: PID 310 died... 11:07:18.221045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=310): Terminated: ok {rc=0} 11:07:18.266962 --- ParallelTerminationStrategy: PID 313 died... 11:07:18.286450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=313): Terminated: ok {rc=0} 11:07:18.332172 --- ParallelTerminationStrategy: PID 316 died... 11:07:18.351573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=316): Terminated: ok {rc=0} 11:07:18.438189 bus /sierra_3: Setting Powered False 11:07:19.536218 bus /sierra_3: Setting Powered False 11:07:20.650653 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:07:21.902755 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:21.907887 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:07:21.954571 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:07:21.980788 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:07:22.034111 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:07:22.081170 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:07:22.107319 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:07:22.658626 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:07:22.663838 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:07:22.674773 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:07:22.710341 tst handover.py: using LAC 27966 11:07:22.833885 tst handover.py: using RAC 171 11:07:22.952859 tst handover.py: using CellId 27966 11:07:23.069398 tst handover.py: using BVCI 27967 11:07:23.187297 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:07:23.231946 tst handover.py: using LAC 27967 11:07:23.357171 tst handover.py: using RAC 172 11:07:23.482312 tst handover.py: using CellId 27967 11:07:23.607247 tst handover.py: using BVCI 27968 11:07:23.719011 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:07:23.730014 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:07:23.740801 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:07:23.752733 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:07:23.764528 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:07:23.776244 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:07:23.921861 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:07:24.041102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:24.514629 run create_hlr_db(pid=323): Launched 11:07:24.646670 bus /sierra_2: Setting Powered False 11:07:25.710381 run create_hlr_db(pid=323): Terminated: ok {rc=0} 11:07:26.131751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=325): Launched 11:07:26.454734 run osmo-hlr_10.42.42.2(pid=326): Launched 11:07:26.578862 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:27.105618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=328): Launched 11:07:27.428821 run osmo-stp_10.42.42.5(pid=329): Launched 11:07:27.552330 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:28.111574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=331): Launched 11:07:28.435169 run osmo-msc_10.42.42.6(pid=332): Launched 11:07:28.617228 run osmo-stp_10.42.42.5(pid=329): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=329)] 11:07:28.754573 run osmo-stp_10.42.42.5(pid=329): stdout: | (launched: 2022-12-10_11:07:27.370075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:28.891807 run osmo-stp_10.42.42.5(pid=329): stderr: | 20221210110727563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110727563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110727564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110727564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110727565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110727565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110727565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:29.027476 run osmo-stp_10.42.42.5(pid=329): stdout: | (launched: 2022-12-10_11:07:27.370075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:29.156429 run osmo-stp_10.42.42.5(pid=329): stderr: | 20221210110727563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110727563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110727564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110727564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110727565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110727565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110727565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:29.310253 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=329): Process ended prematurely: osmo-stp_10.42.42.5(pid=329) [trial-2373↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=329)] [trial-2373↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 11:07:29.319132 tst handover.py:18: Test FAILED (6.6 sec) 11:07:29.346623 run osmo-hlr_10.42.42.2(pid=326): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=326)] 11:07:29.397116 run osmo-hlr_10.42.42.2(pid=326): stdout: | (launched: 2022-12-10_11:07:26.396197) 11:07:29.449444 run osmo-hlr_10.42.42.2(pid=326): stderr: | 20221210110726593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110726593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110726593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110726593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110726593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110726593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110726605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110726614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110726614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110726614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:29.522130 run osmo-msc_10.42.42.6(pid=332): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=332)] 11:07:29.572211 run osmo-msc_10.42.42.6(pid=332): stdout: | (launched: 2022-12-10_11:07:28.376613) 11:07:29.623948 run osmo-msc_10.42.42.6(pid=332): stderr: | 20221210110728699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110728699 DLGLOBAL DEBUG validating counter group 0x7f06ac7ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110728699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110728699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110728700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110728700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110728702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110728702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110728702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110728702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:29.676170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=325): Terminating (SIGTERM) 11:07:29.718077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=328): Terminating (SIGTERM) 11:07:29.759847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=331): Terminating (SIGTERM) 11:07:29.801868 --- ParallelTerminationStrategy: PID 325 died... 11:07:29.821835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=325): Terminated: ok {rc=0} 11:07:29.868232 --- ParallelTerminationStrategy: PID 328 died... 11:07:29.887910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=328): Terminated: ok {rc=0} 11:07:29.934346 --- ParallelTerminationStrategy: PID 331 died... 11:07:29.954077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=331): Terminated: ok {rc=0} 11:07:30.041466 bus /sierra_3: Setting Powered False 11:07:31.144124 bus /sierra_3: Setting Powered False 11:07:32.272573 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:07:33.532859 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:33.538339 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:07:33.590703 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:07:33.617929 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:07:33.671831 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:07:33.723857 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:07:33.750838 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:07:34.302822 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:07:34.308171 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:07:34.319691 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:07:34.354930 tst handover.py: using LAC 27968 11:07:34.483627 tst handover.py: using RAC 173 11:07:34.613141 tst handover.py: using CellId 27968 11:07:34.739493 tst handover.py: using BVCI 27969 11:07:34.858378 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:07:34.907212 tst handover.py: using LAC 27969 11:07:35.033857 tst handover.py: using RAC 174 11:07:35.163250 tst handover.py: using CellId 27969 11:07:35.289715 tst handover.py: using BVCI 27970 11:07:35.406993 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:07:35.418437 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:07:35.430086 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:07:35.441382 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:07:35.452713 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:07:35.463982 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:07:35.584112 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:07:35.699154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:36.159245 run create_hlr_db(pid=337): Launched 11:07:36.290736 bus /sierra_2: Setting Powered False 11:07:37.354525 run create_hlr_db(pid=337): Terminated: ok {rc=0} 11:07:37.762716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=339): Launched 11:07:38.065484 run osmo-hlr_10.42.42.2(pid=340): Launched 11:07:38.183449 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:38.685699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=342): Launched 11:07:38.989465 run osmo-stp_10.42.42.5(pid=343): Launched 11:07:39.105499 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:39.629007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=345): Launched 11:07:39.932237 run osmo-msc_10.42.42.6(pid=347): Launched 11:07:40.103782 run osmo-stp_10.42.42.5(pid=343): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=343)] 11:07:40.233297 run osmo-stp_10.42.42.5(pid=343): stdout: | (launched: 2022-12-10_11:07:38.934357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:40.362045 run osmo-stp_10.42.42.5(pid=343): stderr: | 20221210110739104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110739104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110739104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110739105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110739105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110739105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110739106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:40.488487 run osmo-stp_10.42.42.5(pid=343): stdout: | (launched: 2022-12-10_11:07:38.934357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:40.609629 run osmo-stp_10.42.42.5(pid=343): stderr: | 20221210110739104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110739104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110739104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110739105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110739105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110739105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110739106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:40.754647 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=343): Process ended prematurely: osmo-stp_10.42.42.5(pid=343) [trial-2373↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=343)] [trial-2373↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 11:07:40.762684 tst handover.py:18: Test FAILED (6.4 sec) 11:07:40.789292 run osmo-hlr_10.42.42.2(pid=340): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=340)] 11:07:40.837592 run osmo-hlr_10.42.42.2(pid=340): stdout: | (launched: 2022-12-10_11:07:38.010867) 11:07:40.887368 run osmo-hlr_10.42.42.2(pid=340): stderr: | 20221210110738185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110738185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110738185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110738185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110738185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110738185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110738197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110738205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110738206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110738206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:40.956658 run osmo-msc_10.42.42.6(pid=347): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=347)] 11:07:41.004815 run osmo-msc_10.42.42.6(pid=347): stdout: | (launched: 2022-12-10_11:07:39.877303) 11:07:41.054541 run osmo-msc_10.42.42.6(pid=347): stderr: | 20221210110740148 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110740148 DLGLOBAL DEBUG validating counter group 0x7f7de25a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110740149 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110740149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110740149 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110740149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110740151 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110740151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110740151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110740151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:41.104647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=339): Terminating (SIGTERM) 11:07:41.144829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=342): Terminating (SIGTERM) 11:07:41.184852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=345): Terminating (SIGTERM) 11:07:41.225424 --- ParallelTerminationStrategy: PID 339 died... 11:07:41.244352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=339): Terminated: ok {rc=0} 11:07:41.289048 --- ParallelTerminationStrategy: PID 342 died... 11:07:41.307616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=342): Terminated: ok {rc=0} 11:07:41.351915 --- ParallelTerminationStrategy: PID 345 died... 11:07:41.370422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=345): Terminated: ok {rc=0} 11:07:41.456213 bus /sierra_3: Setting Powered False 11:07:42.555868 bus /sierra_3: Setting Powered False 11:07:43.668496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 11:07:44.928857 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:44.934352 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:07:44.973772 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:07:45.001155 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:07:45.055327 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:07:45.094604 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:07:45.121657 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:07:45.674270 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 11:07:45.680723 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:07:45.692792 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:07:45.728394 tst handover.py: using LAC 27970 11:07:45.867710 tst handover.py: using RAC 175 11:07:46.007480 tst handover.py: using CellId 27970 11:07:46.135878 tst handover.py: using BVCI 27971 11:07:46.256104 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 11:07:46.290814 tst handover.py: using LAC 27971 11:07:46.427672 tst handover.py: using RAC 176 11:07:46.553804 tst handover.py: using CellId 27971 11:07:46.710738 tst handover.py: using BVCI 27972 11:07:46.827140 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:07:46.839247 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:07:46.852020 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:07:46.865031 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:07:46.876635 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:07:46.890466 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:07:47.030046 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 11:07:47.153540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:47.604194 run create_hlr_db(pid=359): Launched 11:07:47.721768 bus /sierra_2: Setting Powered False 11:07:48.782113 run create_hlr_db(pid=359): Terminated: ok {rc=0} 11:07:49.179047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=361): Launched 11:07:49.481636 run osmo-hlr_10.42.42.2(pid=362): Launched 11:07:49.598129 run osmo-stp_10.42.42.5: Starting osmo-stp 11:07:50.092794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=369): Launched 11:07:50.395598 run osmo-stp_10.42.42.5(pid=370): Launched 11:07:50.512348 run osmo-msc_10.42.42.6: Starting osmo-msc 11:07:51.033762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=372): Launched 11:07:51.337143 run osmo-msc_10.42.42.6(pid=373): Launched 11:07:51.506772 run osmo-stp_10.42.42.5(pid=370): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=370)] 11:07:51.634759 run osmo-stp_10.42.42.5(pid=370): stdout: | (launched: 2022-12-10_11:07:50.340573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:51.762977 run osmo-stp_10.42.42.5(pid=370): stderr: | 20221210110750511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110750512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110750512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110750512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110750513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110750513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110750513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:51.888575 run osmo-stp_10.42.42.5(pid=370): stdout: | (launched: 2022-12-10_11:07:50.340573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:07:52.009264 run osmo-stp_10.42.42.5(pid=370): stderr: | 20221210110750511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110750512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110750512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110750512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110750513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110750513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110750513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:07:52.153538 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=370): Process ended prematurely: osmo-stp_10.42.42.5(pid=370) [trial-2373↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=370)] [trial-2373↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 11:07:52.161602 tst handover.py:18: Test FAILED (6.5 sec) 11:07:52.188069 run osmo-hlr_10.42.42.2(pid=362): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=362)] 11:07:52.235725 run osmo-hlr_10.42.42.2(pid=362): stdout: | (launched: 2022-12-10_11:07:49.426644) 11:07:52.285170 run osmo-hlr_10.42.42.2(pid=362): stderr: | 20221210110749603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110749604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110749604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110749604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110749604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110749604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110749616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110749626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110749626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110749626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:07:52.353849 run osmo-msc_10.42.42.6(pid=373): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=373)] 11:07:52.401425 run osmo-msc_10.42.42.6(pid=373): stdout: | (launched: 2022-12-10_11:07:51.281951) 11:07:52.450626 run osmo-msc_10.42.42.6(pid=373): stderr: | 20221210110751554 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110751554 DLGLOBAL DEBUG validating counter group 0x7f8e3a40ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110751554 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110751554 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110751554 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110751555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110751556 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110751557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110751557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110751557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:07:52.500041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=361): Terminating (SIGTERM) 11:07:52.539740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=369): Terminating (SIGTERM) 11:07:52.579520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=372): Terminating (SIGTERM) 11:07:52.619573 --- ParallelTerminationStrategy: PID 361 died... 11:07:52.638550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=361): Terminated: ok {rc=0} 11:07:52.682825 --- ParallelTerminationStrategy: PID 369 died... 11:07:52.701333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=369): Terminated: ok {rc=0} 11:07:52.745360 --- ParallelTerminationStrategy: PID 372 died... 11:07:52.763801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=372): Terminated: ok {rc=0} 11:07:52.850248 bus /sierra_3: Setting Powered False 11:07:53.953806 bus /sierra_3: Setting Powered False 11:07:55.068002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 11:07:56.306092 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:07:56.312021 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:07:56.363922 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:07:56.391407 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:07:56.444749 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:07:56.496761 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:07:56.524394 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:07:57.077838 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 11:07:57.083318 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:07:57.094725 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:07:57.129866 tst handover.py: using LAC 27972 11:07:57.258216 tst handover.py: using RAC 177 11:07:57.385380 tst handover.py: using CellId 27972 11:07:57.512306 tst handover.py: using BVCI 27973 11:07:57.629856 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:07:57.680044 tst handover.py: using LAC 27973 11:07:57.808116 tst handover.py: using RAC 178 11:07:57.929563 tst handover.py: using CellId 27973 11:07:58.048458 tst handover.py: using BVCI 27974 11:07:58.158906 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:07:58.169843 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:07:58.180311 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:07:58.191354 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:07:58.202501 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:07:58.213208 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:07:58.330737 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:07:58.446920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:07:58.919039 run create_hlr_db(pid=378): Launched 11:07:59.049593 bus /sierra_2: Setting Powered False 11:08:00.111210 run create_hlr_db(pid=378): Terminated: ok {rc=0} 11:08:00.508073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=380): Launched 11:08:00.810030 run osmo-hlr_10.42.42.2(pid=381): Launched 11:08:01.029805 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:01.629934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=383): Launched 11:08:01.951253 run osmo-stp_10.42.42.5(pid=384): Launched 11:08:02.225151 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:02.798358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=386): Launched 11:08:03.101201 run osmo-msc_10.42.42.6(pid=387): Launched 11:08:03.271359 run osmo-stp_10.42.42.5(pid=384): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=384)] 11:08:03.399430 run osmo-stp_10.42.42.5(pid=384): stdout: | (launched: 2022-12-10_11:08:01.890117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:03.527487 run osmo-stp_10.42.42.5(pid=384): stderr: | 20221210110802131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110802131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110802131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110802131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110802132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110802132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110802132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:03.653690 run osmo-stp_10.42.42.5(pid=384): stdout: | (launched: 2022-12-10_11:08:01.890117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:03.774375 run osmo-stp_10.42.42.5(pid=384): stderr: | 20221210110802131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110802131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110802131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110802131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110802132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110802132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110802132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:03.918772 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=384): Process ended prematurely: osmo-stp_10.42.42.5(pid=384) [trial-2373↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=384)] [trial-2373↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 11:08:03.926845 tst handover.py:18: Test FAILED (6.8 sec) 11:08:03.953579 run osmo-hlr_10.42.42.2(pid=381): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=381)] 11:08:04.002473 run osmo-hlr_10.42.42.2(pid=381): stdout: | (launched: 2022-12-10_11:08:00.755313) 11:08:04.052203 run osmo-hlr_10.42.42.2(pid=381): stderr: | 20221210110800984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110800984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110800984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110800984 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110800984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110800984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110800997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110801010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110801010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110801010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:04.121475 run osmo-msc_10.42.42.6(pid=387): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=387)] 11:08:04.169594 run osmo-msc_10.42.42.6(pid=387): stdout: | (launched: 2022-12-10_11:08:03.046404) 11:08:04.219331 run osmo-msc_10.42.42.6(pid=387): stderr: | 20221210110803315 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110803315 DLGLOBAL DEBUG validating counter group 0x7f13f251fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110803316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110803316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110803316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110803316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110803318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110803318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110803318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110803318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:04.269393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=380): Terminating (SIGTERM) 11:08:04.309422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=383): Terminating (SIGTERM) 11:08:04.349687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=386): Terminating (SIGTERM) 11:08:04.390376 --- ParallelTerminationStrategy: PID 380 died... 11:08:04.409267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=380): Terminated: ok {rc=0} 11:08:04.454349 --- ParallelTerminationStrategy: PID 383 died... 11:08:04.472722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=383): Terminated: ok {rc=0} 11:08:04.517693 --- ParallelTerminationStrategy: PID 386 died... 11:08:04.536090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=386): Terminated: ok {rc=0} 11:08:04.622256 bus /sierra_3: Setting Powered False 11:08:05.720431 bus /sierra_3: Setting Powered False 11:08:06.836050 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 11:08:08.090234 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:08.097096 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:08:08.148354 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:08:08.176085 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:08:08.230516 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:08:08.281674 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:08:08.308727 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:08:08.859990 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 11:08:08.865659 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:08:08.877419 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:08:08.913016 tst handover.py: using LAC 27974 11:08:09.040518 tst handover.py: using RAC 179 11:08:09.168646 tst handover.py: using CellId 27974 11:08:09.296398 tst handover.py: using BVCI 27975 11:08:09.413444 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:08:09.463013 tst handover.py: using LAC 27975 11:08:09.590645 tst handover.py: using RAC 180 11:08:09.716438 tst handover.py: using CellId 27975 11:08:09.840542 tst handover.py: using BVCI 27976 11:08:09.952201 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:08:09.963024 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:08:09.973653 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:08:09.984592 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:08:09.995480 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:08:10.006438 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:08:10.124740 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:08:10.239847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:10.684873 run create_hlr_db(pid=392): Launched 11:08:10.800806 bus /sierra_2: Setting Powered False 11:08:11.860149 run create_hlr_db(pid=392): Terminated: ok {rc=0} 11:08:12.275910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=394): Launched 11:08:12.600091 run osmo-hlr_10.42.42.2(pid=395): Launched 11:08:12.724302 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:13.253430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=397): Launched 11:08:13.577675 run osmo-stp_10.42.42.5(pid=398): Launched 11:08:13.701361 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:14.261038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=400): Launched 11:08:14.584780 run osmo-msc_10.42.42.6(pid=401): Launched 11:08:14.765412 run osmo-stp_10.42.42.5(pid=398): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=398)] 11:08:14.901811 run osmo-stp_10.42.42.5(pid=398): stdout: | (launched: 2022-12-10_11:08:13.519474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:15.039572 run osmo-stp_10.42.42.5(pid=398): stderr: | 20221210110813713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110813713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110813714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110813714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110813714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110813714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110813714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:15.175764 run osmo-stp_10.42.42.5(pid=398): stdout: | (launched: 2022-12-10_11:08:13.519474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:15.304563 run osmo-stp_10.42.42.5(pid=398): stderr: | 20221210110813713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110813713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110813714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110813714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110813714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110813714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110813714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:15.459846 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=398): Process ended prematurely: osmo-stp_10.42.42.5(pid=398) [trial-2373↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=398)] [trial-2373↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 11:08:15.468777 tst handover.py:18: Test FAILED (6.6 sec) 11:08:15.496410 run osmo-hlr_10.42.42.2(pid=395): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=395)] 11:08:15.546773 run osmo-hlr_10.42.42.2(pid=395): stdout: | (launched: 2022-12-10_11:08:12.541590) 11:08:15.599217 run osmo-hlr_10.42.42.2(pid=395): stderr: | 20221210110812740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110812740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110812740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110812740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110812740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110812740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110812752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110812761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110812761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110812761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:15.671774 run osmo-msc_10.42.42.6(pid=401): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=401)] 11:08:15.722006 run osmo-msc_10.42.42.6(pid=401): stdout: | (launched: 2022-12-10_11:08:14.526375) 11:08:15.773946 run osmo-msc_10.42.42.6(pid=401): stderr: | 20221210110814846 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110814846 DLGLOBAL DEBUG validating counter group 0x7f533bd64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110814846 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110814846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110814846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110814847 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110814848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110814849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110814849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110814849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:15.826119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=394): Terminating (SIGTERM) 11:08:15.888560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=397): Terminating (SIGTERM) 11:08:15.934053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=400): Terminating (SIGTERM) 11:08:15.978397 --- ParallelTerminationStrategy: PID 394 died... 11:08:15.998371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=394): Terminated: ok {rc=0} 11:08:16.047592 --- ParallelTerminationStrategy: PID 397 died... 11:08:16.067180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=397): Terminated: ok {rc=0} 11:08:16.116447 --- ParallelTerminationStrategy: PID 400 died... 11:08:16.136242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=400): Terminated: ok {rc=0} 11:08:16.224259 bus /sierra_3: Setting Powered False 11:08:17.341782 bus /sierra_3: Setting Powered False 11:08:18.476453 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 11:08:19.742998 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:19.749005 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 11:08:19.800753 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 11:08:19.829570 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 11:08:19.883419 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 11:08:19.936665 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 11:08:19.965551 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 11:08:20.509403 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 11:08:20.516123 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:20.527863 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:08:20.565594 tst handover.py: using LAC 27976 11:08:20.686911 tst handover.py: using RAC 181 11:08:20.811908 tst handover.py: using CellId 27976 11:08:20.937952 tst handover.py: using BVCI 27977 11:08:21.052832 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 11:08:21.103240 tst handover.py: using LAC 27977 11:08:21.224797 tst handover.py: using RAC 182 11:08:21.349391 tst handover.py: using CellId 27977 11:08:21.470922 tst handover.py: using BVCI 27978 11:08:21.585310 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:21.597305 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:21.608865 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:21.621700 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:21.635220 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 11:08:21.647137 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:08:21.768749 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 11:08:21.885987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:22.347006 run create_hlr_db(pid=678): Launched 11:08:22.503545 bus /sierra_2: Setting Powered False 11:08:23.565971 run create_hlr_db(pid=678): Terminated: ok {rc=0} 11:08:23.987768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=680): Launched 11:08:24.329758 run osmo-hlr_10.42.42.2(pid=681): Launched 11:08:24.579319 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:25.286673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=683): Launched 11:08:25.613546 run osmo-stp_10.42.42.5(pid=684): Launched 11:08:25.797250 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:26.553776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=686): Launched 11:08:26.889731 run osmo-msc_10.42.42.6(pid=687): Launched 11:08:27.243107 run osmo-stp_10.42.42.5(pid=684): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=684)] 11:08:27.517521 run osmo-stp_10.42.42.5(pid=684): stdout: | (launched: 2022-12-10_11:08:25.551606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:27.786106 run osmo-stp_10.42.42.5(pid=684): stderr: | 20221210110825898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110825898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110825898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110825898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110825899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110825899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110825899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:27.966636 run osmo-stp_10.42.42.5(pid=684): stdout: | (launched: 2022-12-10_11:08:25.551606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:28.091376 run osmo-stp_10.42.42.5(pid=684): stderr: | 20221210110825898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110825898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110825898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110825898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110825899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110825899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110825899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:28.241201 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=684): Process ended prematurely: osmo-stp_10.42.42.5(pid=684) [trial-2373↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=684)] [trial-2373↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 11:08:28.250483 tst handover.py:18: Test FAILED (7.7 sec) 11:08:28.280674 run osmo-hlr_10.42.42.2(pid=681): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=681)] 11:08:28.332078 run osmo-hlr_10.42.42.2(pid=681): stdout: | (launched: 2022-12-10_11:08:24.257488) 11:08:28.384709 run osmo-hlr_10.42.42.2(pid=681): stderr: | 20221210110824605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110824605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110824605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110824605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110824605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110824606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110824626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110824638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110824638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110824638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:28.457374 run osmo-msc_10.42.42.6(pid=687): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=687)] 11:08:28.509174 run osmo-msc_10.42.42.6(pid=687): stdout: | (launched: 2022-12-10_11:08:26.817133) 11:08:28.561493 run osmo-msc_10.42.42.6(pid=687): stderr: | 20221210110827406 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110827407 DLGLOBAL DEBUG validating counter group 0x7ff2df029c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110827407 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110827407 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110827407 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110827407 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110827417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110827418 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110827418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110827418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:28.614307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=680): Terminating (SIGTERM) 11:08:28.656937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=683): Terminating (SIGTERM) 11:08:28.702883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=686): Terminating (SIGTERM) 11:08:28.747413 --- ParallelTerminationStrategy: PID 680 died... 11:08:28.767612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=680): Terminated: ok {rc=0} 11:08:28.817158 --- ParallelTerminationStrategy: PID 683 died... 11:08:28.836591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=683): Terminated: ok {rc=0} 11:08:28.885207 --- ParallelTerminationStrategy: PID 686 died... 11:08:28.905836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=686): Terminated: ok {rc=0} 11:08:28.994807 bus /sierra_3: Setting Powered False 11:08:30.096388 bus /sierra_3: Setting Powered False 11:08:31.236436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:08:32.569649 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:32.575357 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:08:32.622801 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:08:32.650637 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:08:32.703522 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:08:32.750144 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:08:32.778497 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:08:33.333133 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:08:33.340284 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:33.353526 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:08:33.388819 tst handover.py: using LAC 27978 11:08:33.518737 tst handover.py: using RAC 183 11:08:33.651254 tst handover.py: using CellId 27978 11:08:33.781257 tst handover.py: using BVCI 27979 11:08:33.903737 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:08:33.948102 tst handover.py: using LAC 27979 11:08:34.075955 tst handover.py: using RAC 184 11:08:34.205245 tst handover.py: using CellId 27979 11:08:34.339840 tst handover.py: using BVCI 27980 11:08:34.462104 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:34.474712 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:34.487091 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:34.500881 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:34.513469 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:08:34.526766 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:08:34.650885 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:08:34.775779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:35.272578 run create_hlr_db(pid=692): Launched 11:08:35.440180 bus /sierra_2: Setting Powered False 11:08:36.506669 run create_hlr_db(pid=692): Terminated: ok {rc=0} 11:08:36.951888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=694): Launched 11:08:37.304047 run osmo-hlr_10.42.42.2(pid=695): Launched 11:08:37.557537 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:38.172535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=697): Launched 11:08:38.476266 run osmo-stp_10.42.42.5(pid=698): Launched 11:08:38.593463 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:39.114114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=700): Launched 11:08:39.416783 run osmo-msc_10.42.42.6(pid=701): Launched 11:08:39.586630 run osmo-stp_10.42.42.5(pid=698): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=698)] 11:08:39.714192 run osmo-stp_10.42.42.5(pid=698): stdout: | (launched: 2022-12-10_11:08:38.421238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:39.841958 run osmo-stp_10.42.42.5(pid=698): stderr: | 20221210110838592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110838592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110838592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110838593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110838593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110838593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110838593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:39.968198 run osmo-stp_10.42.42.5(pid=698): stdout: | (launched: 2022-12-10_11:08:38.421238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:40.088505 run osmo-stp_10.42.42.5(pid=698): stderr: | 20221210110838592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110838592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110838592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110838593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110838593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110838593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110838593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:40.233102 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=698): Process ended prematurely: osmo-stp_10.42.42.5(pid=698) [trial-2373↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=698)] [trial-2373↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 11:08:40.241394 tst handover.py:18: Test FAILED (6.9 sec) 11:08:40.267997 run osmo-hlr_10.42.42.2(pid=695): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=695)] 11:08:40.315753 run osmo-hlr_10.42.42.2(pid=695): stdout: | (launched: 2022-12-10_11:08:37.237040) 11:08:40.365119 run osmo-hlr_10.42.42.2(pid=695): stderr: | 20221210110837552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110837552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110837552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110837552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110837552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110837552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110837572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110837583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110837583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110837583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:40.433730 run osmo-msc_10.42.42.6(pid=701): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=701)] 11:08:40.481376 run osmo-msc_10.42.42.6(pid=701): stdout: | (launched: 2022-12-10_11:08:39.362090) 11:08:40.530539 run osmo-msc_10.42.42.6(pid=701): stderr: | 20221210110839634 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110839634 DLGLOBAL DEBUG validating counter group 0x7ff4b39e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110839634 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110839634 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110839634 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110839634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110839636 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110839636 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110839637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110839637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:40.580069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=694): Terminating (SIGTERM) 11:08:40.620054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=697): Terminating (SIGTERM) 11:08:40.660039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=700): Terminating (SIGTERM) 11:08:40.700307 --- ParallelTerminationStrategy: PID 694 died... 11:08:40.719416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=694): Terminated: ok {rc=0} 11:08:40.763892 --- ParallelTerminationStrategy: PID 697 died... 11:08:40.782506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=697): Terminated: ok {rc=0} 11:08:40.826855 --- ParallelTerminationStrategy: PID 700 died... 11:08:40.845452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=700): Terminated: ok {rc=0} 11:08:40.931696 bus /sierra_3: Setting Powered False 11:08:42.031325 bus /sierra_3: Setting Powered False 11:08:43.147638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:08:44.400662 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:44.406617 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:08:44.458682 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:08:44.486899 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:08:44.542177 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:08:44.592936 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:08:44.620020 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:08:45.171780 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:08:45.177284 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:45.188545 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:08:45.222148 tst handover.py: using LAC 27980 11:08:45.349518 tst handover.py: using RAC 185 11:08:45.471233 tst handover.py: using CellId 27980 11:08:45.596687 tst handover.py: using BVCI 27981 11:08:45.708740 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:08:45.755787 tst handover.py: using LAC 27981 11:08:45.899518 tst handover.py: using RAC 186 11:08:46.045402 tst handover.py: using CellId 27981 11:08:46.166530 tst handover.py: using BVCI 27982 11:08:46.279664 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:46.291315 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:46.302711 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:46.314533 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:46.326358 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:08:46.338106 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:08:46.456136 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:08:46.573402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:47.030863 run create_hlr_db(pid=706): Launched 11:08:47.179604 bus /sierra_2: Setting Powered False 11:08:48.240019 run create_hlr_db(pid=706): Terminated: ok {rc=0} 11:08:48.636903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=708): Launched 11:08:48.940452 run osmo-hlr_10.42.42.2(pid=709): Launched 11:08:49.056573 run osmo-stp_10.42.42.5: Starting osmo-stp 11:08:49.564788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=711): Launched 11:08:49.867072 run osmo-stp_10.42.42.5(pid=712): Launched 11:08:49.982582 run osmo-msc_10.42.42.6: Starting osmo-msc 11:08:50.502402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=714): Launched 11:08:50.805501 run osmo-msc_10.42.42.6(pid=715): Launched 11:08:50.975553 run osmo-stp_10.42.42.5(pid=712): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=712)] 11:08:51.103138 run osmo-stp_10.42.42.5(pid=712): stdout: | (launched: 2022-12-10_11:08:49.812716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:51.230944 run osmo-stp_10.42.42.5(pid=712): stderr: | 20221210110849980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110849981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110849981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110849981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110849982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110849982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110849982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:51.358129 run osmo-stp_10.42.42.5(pid=712): stdout: | (launched: 2022-12-10_11:08:49.812716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:08:51.479179 run osmo-stp_10.42.42.5(pid=712): stderr: | 20221210110849980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110849981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110849981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110849981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110849982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110849982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110849982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:08:51.623736 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=712): Process ended prematurely: osmo-stp_10.42.42.5(pid=712) [trial-2373↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=712)] [trial-2373↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 11:08:51.632048 tst handover.py:18: Test FAILED (6.4 sec) 11:08:51.658597 run osmo-hlr_10.42.42.2(pid=709): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=709)] 11:08:51.706643 run osmo-hlr_10.42.42.2(pid=709): stdout: | (launched: 2022-12-10_11:08:48.885414) 11:08:51.756324 run osmo-hlr_10.42.42.2(pid=709): stderr: | 20221210110849059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110849059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110849059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110849060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110849060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110849060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110849071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110849080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110849080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110849080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:08:51.825909 run osmo-msc_10.42.42.6(pid=715): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=715)] 11:08:51.873997 run osmo-msc_10.42.42.6(pid=715): stdout: | (launched: 2022-12-10_11:08:50.750770) 11:08:51.923881 run osmo-msc_10.42.42.6(pid=715): stderr: | 20221210110851021 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110851021 DLGLOBAL DEBUG validating counter group 0x7f8091340c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110851021 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110851021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110851022 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110851022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110851023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110851024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110851024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110851024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:08:51.973850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=708): Terminating (SIGTERM) 11:08:52.013567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=711): Terminating (SIGTERM) 11:08:52.053387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=714): Terminating (SIGTERM) 11:08:52.093590 --- ParallelTerminationStrategy: PID 708 died... 11:08:52.112637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=708): Terminated: ok {rc=0} 11:08:52.157177 --- ParallelTerminationStrategy: PID 711 died... 11:08:52.175811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=711): Terminated: ok {rc=0} 11:08:52.219851 --- ParallelTerminationStrategy: PID 714 died... 11:08:52.238352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=714): Terminated: ok {rc=0} 11:08:52.321703 bus /sierra_3: Setting Powered False 11:08:53.417784 bus /sierra_3: Setting Powered False 11:08:54.532558 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 11:08:55.808408 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:08:55.814669 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:08:55.852106 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:08:55.879024 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:08:55.938226 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:08:55.976238 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:08:56.002615 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:08:56.550007 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 11:08:56.556223 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:08:56.567994 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:08:56.602086 tst handover.py: using LAC 27982 11:08:56.723501 tst handover.py: using RAC 187 11:08:56.842567 tst handover.py: using CellId 27982 11:08:56.962647 tst handover.py: using BVCI 27983 11:08:57.074706 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 11:08:57.109177 tst handover.py: using LAC 27983 11:08:57.232701 tst handover.py: using RAC 188 11:08:57.351510 tst handover.py: using CellId 27983 11:08:57.470791 tst handover.py: using BVCI 27984 11:08:57.590038 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:08:57.601546 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:08:57.612646 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:08:57.624371 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:08:57.636173 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:08:57.647839 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:08:57.764902 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 11:08:57.884092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:08:58.357627 run create_hlr_db(pid=721): Launched 11:08:58.489580 bus /sierra_2: Setting Powered False 11:08:59.554259 run create_hlr_db(pid=721): Terminated: ok {rc=0} 11:08:59.976457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=723): Launched 11:09:00.300206 run osmo-hlr_10.42.42.2(pid=724): Launched 11:09:00.424219 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:00.985736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=726): Launched 11:09:01.314915 run osmo-stp_10.42.42.5(pid=727): Launched 11:09:01.457636 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:02.242837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=729): Launched 11:09:02.552828 run osmo-msc_10.42.42.6(pid=730): Launched 11:09:02.723424 run osmo-stp_10.42.42.5(pid=727): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=727)] 11:09:02.851848 run osmo-stp_10.42.42.5(pid=727): stdout: | (launched: 2022-12-10_11:09:01.251467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:02.980261 run osmo-stp_10.42.42.5(pid=727): stderr: | 20221210110901625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110901625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110901627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110901629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110901631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110901631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110901631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:03.106001 run osmo-stp_10.42.42.5(pid=727): stdout: | (launched: 2022-12-10_11:09:01.251467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:03.226092 run osmo-stp_10.42.42.5(pid=727): stderr: | 20221210110901625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110901625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110901627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110901629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110901631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110901631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110901631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:03.369715 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=727): Process ended prematurely: osmo-stp_10.42.42.5(pid=727) [trial-2373↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=727)] [trial-2373↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 11:09:03.377914 tst handover.py:18: Test FAILED (6.8 sec) 11:09:03.404529 run osmo-hlr_10.42.42.2(pid=724): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=724)] 11:09:03.452124 run osmo-hlr_10.42.42.2(pid=724): stdout: | (launched: 2022-12-10_11:09:00.240732) 11:09:03.501513 run osmo-hlr_10.42.42.2(pid=724): stderr: | 20221210110900437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110900437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110900437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110900437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110900437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110900437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110900450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110900458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110900459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110900459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:03.570644 run osmo-msc_10.42.42.6(pid=730): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=730)] 11:09:03.618317 run osmo-msc_10.42.42.6(pid=730): stdout: | (launched: 2022-12-10_11:09:02.497573) 11:09:03.667574 run osmo-msc_10.42.42.6(pid=730): stderr: | 20221210110902767 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110902767 DLGLOBAL DEBUG validating counter group 0x7f2c8fbb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110902768 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110902768 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110902768 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110902768 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110902770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110902770 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110902770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110902770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:03.717198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=723): Terminating (SIGTERM) 11:09:03.756987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=726): Terminating (SIGTERM) 11:09:03.796872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=729): Terminating (SIGTERM) 11:09:03.837123 --- ParallelTerminationStrategy: PID 723 died... 11:09:03.856119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=723): Terminated: ok {rc=0} 11:09:03.900617 --- ParallelTerminationStrategy: PID 726 died... 11:09:03.919097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=726): Terminated: ok {rc=0} 11:09:03.963225 --- ParallelTerminationStrategy: PID 729 died... 11:09:03.981633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=729): Terminated: ok {rc=0} 11:09:04.065523 bus /sierra_3: Setting Powered False 11:09:05.163359 bus /sierra_3: Setting Powered False 11:09:06.282722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 11:09:07.522359 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:07.527692 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:09:07.580483 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:09:07.608197 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:09:07.663408 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:09:07.713676 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:09:07.740769 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:09:08.292130 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 11:09:08.297918 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:08.309362 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:09:08.346768 tst handover.py: using LAC 27984 11:09:08.473204 tst handover.py: using RAC 189 11:09:08.598637 tst handover.py: using CellId 27984 11:09:08.727510 tst handover.py: using BVCI 27985 11:09:08.845186 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:09:08.894315 tst handover.py: using LAC 27985 11:09:09.022264 tst handover.py: using RAC 190 11:09:09.150726 tst handover.py: using CellId 27985 11:09:09.271214 tst handover.py: using BVCI 27986 11:09:09.383376 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:09.394352 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:09.405243 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:09.416428 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:09.427850 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:09:09.439161 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:09:09.558910 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:09:09.677995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:10.148661 run create_hlr_db(pid=735): Launched 11:09:10.280485 bus /sierra_2: Setting Powered False 11:09:11.345220 run create_hlr_db(pid=735): Terminated: ok {rc=0} 11:09:11.752742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=737): Launched 11:09:12.054799 run osmo-hlr_10.42.42.2(pid=738): Launched 11:09:12.171216 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:12.679119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=740): Launched 11:09:12.981364 run osmo-stp_10.42.42.5(pid=741): Launched 11:09:13.097769 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:13.618600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=743): Launched 11:09:13.920560 run osmo-msc_10.42.42.6(pid=744): Launched 11:09:14.090466 run osmo-stp_10.42.42.5(pid=741): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=741)] 11:09:14.218882 run osmo-stp_10.42.42.5(pid=741): stdout: | (launched: 2022-12-10_11:09:12.926320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:14.347442 run osmo-stp_10.42.42.5(pid=741): stderr: | 20221210110913096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110913096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110913096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110913097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110913097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110913098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110913098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:14.474059 run osmo-stp_10.42.42.5(pid=741): stdout: | (launched: 2022-12-10_11:09:12.926320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:14.594323 run osmo-stp_10.42.42.5(pid=741): stderr: | 20221210110913096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110913096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110913096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110913097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110913097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110913098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110913098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:14.738507 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=741): Process ended prematurely: osmo-stp_10.42.42.5(pid=741) [trial-2373↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=741)] [trial-2373↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 11:09:14.746679 tst handover.py:18: Test FAILED (6.4 sec) 11:09:14.773254 run osmo-hlr_10.42.42.2(pid=738): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=738)] 11:09:14.820832 run osmo-hlr_10.42.42.2(pid=738): stdout: | (launched: 2022-12-10_11:09:12.000129) 11:09:14.870254 run osmo-hlr_10.42.42.2(pid=738): stderr: | 20221210110912176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110912176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110912176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110912176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110912176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110912176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110912188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110912196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110912197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110912197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:14.939189 run osmo-msc_10.42.42.6(pid=744): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=744)] 11:09:14.986832 run osmo-msc_10.42.42.6(pid=744): stdout: | (launched: 2022-12-10_11:09:13.865758) 11:09:15.035931 run osmo-msc_10.42.42.6(pid=744): stderr: | 20221210110914133 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110914133 DLGLOBAL DEBUG validating counter group 0x7fa39eb28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110914133 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110914134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110914134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110914134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110914136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110914136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110914136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110914136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:15.085559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=737): Terminating (SIGTERM) 11:09:15.125211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=740): Terminating (SIGTERM) 11:09:15.165127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=743): Terminating (SIGTERM) 11:09:15.205189 --- ParallelTerminationStrategy: PID 737 died... 11:09:15.224212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=737): Terminated: ok {rc=0} 11:09:15.268493 --- ParallelTerminationStrategy: PID 740 died... 11:09:15.286916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=740): Terminated: ok {rc=0} 11:09:15.331170 --- ParallelTerminationStrategy: PID 743 died... 11:09:15.349794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=743): Terminated: ok {rc=0} 11:09:15.435364 bus /sierra_3: Setting Powered False 11:09:16.546543 bus /sierra_3: Setting Powered False 11:09:17.679137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 11:09:18.937385 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:18.943168 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:09:18.993627 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:09:19.021291 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:09:19.075276 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:09:19.125502 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:09:19.152744 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:09:19.704140 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 11:09:19.709921 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:19.721331 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:09:19.756345 tst handover.py: using LAC 27986 11:09:19.883549 tst handover.py: using RAC 191 11:09:20.010184 tst handover.py: using CellId 27986 11:09:20.138878 tst handover.py: using BVCI 27987 11:09:20.258062 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:09:20.307311 tst handover.py: using LAC 27987 11:09:20.435667 tst handover.py: using RAC 192 11:09:20.555069 tst handover.py: using CellId 27987 11:09:20.675538 tst handover.py: using BVCI 27988 11:09:20.786970 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:20.797798 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:20.808391 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:20.819387 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:20.830281 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:09:20.841045 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:09:20.957162 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:09:21.077886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:21.552010 run create_hlr_db(pid=749): Launched 11:09:21.684881 bus /sierra_2: Setting Powered False 11:09:22.749214 run create_hlr_db(pid=749): Terminated: ok {rc=0} 11:09:23.172853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=751): Launched 11:09:23.498155 run osmo-hlr_10.42.42.2(pid=752): Launched 11:09:23.623419 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:24.156353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=754): Launched 11:09:24.479983 run osmo-stp_10.42.42.5(pid=755): Launched 11:09:24.604413 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:25.162313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=757): Launched 11:09:25.486628 run osmo-msc_10.42.42.6(pid=758): Launched 11:09:25.669294 run osmo-stp_10.42.42.5(pid=755): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=755)] 11:09:25.805685 run osmo-stp_10.42.42.5(pid=755): stdout: | (launched: 2022-12-10_11:09:24.421843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:25.942205 run osmo-stp_10.42.42.5(pid=755): stderr: | 20221210110924616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110924616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110924616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110924617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110924617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110924617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110924618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:26.078267 run osmo-stp_10.42.42.5(pid=755): stdout: | (launched: 2022-12-10_11:09:24.421843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:26.207749 run osmo-stp_10.42.42.5(pid=755): stderr: | 20221210110924616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110924616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110924616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110924617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110924617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110924617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110924618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:26.362516 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=755): Process ended prematurely: osmo-stp_10.42.42.5(pid=755) [trial-2373↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=755)] [trial-2373↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 11:09:26.371468 tst handover.py:18: Test FAILED (6.7 sec) 11:09:26.399502 run osmo-hlr_10.42.42.2(pid=752): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=752)] 11:09:26.450081 run osmo-hlr_10.42.42.2(pid=752): stdout: | (launched: 2022-12-10_11:09:23.439634) 11:09:26.502625 run osmo-hlr_10.42.42.2(pid=752): stderr: | 20221210110923638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110923638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110923638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110923638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110923638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110923638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110923650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110923658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110923659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110923659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:26.575477 run osmo-msc_10.42.42.6(pid=758): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=758)] 11:09:26.626029 run osmo-msc_10.42.42.6(pid=758): stdout: | (launched: 2022-12-10_11:09:25.428152) 11:09:26.678003 run osmo-msc_10.42.42.6(pid=758): stderr: | 20221210110925752 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110925752 DLGLOBAL DEBUG validating counter group 0x7f8254abbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110925752 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110925752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110925752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110925753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110925754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110925755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110925755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110925755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:26.730390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=751): Terminating (SIGTERM) 11:09:26.772557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=754): Terminating (SIGTERM) 11:09:26.814718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=757): Terminating (SIGTERM) 11:09:26.857201 --- ParallelTerminationStrategy: PID 751 died... 11:09:26.877070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=751): Terminated: ok {rc=0} 11:09:26.923063 --- ParallelTerminationStrategy: PID 754 died... 11:09:26.942465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=754): Terminated: ok {rc=0} 11:09:26.988170 --- ParallelTerminationStrategy: PID 757 died... 11:09:27.007726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=757): Terminated: ok {rc=0} 11:09:27.095579 bus /sierra_3: Setting Powered False 11:09:28.193260 bus /sierra_3: Setting Powered False 11:09:29.309449 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 11:09:30.568743 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:30.574674 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 11:09:30.635043 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 11:09:30.662574 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 11:09:30.716257 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 11:09:30.776468 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 11:09:30.803509 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 11:09:31.359784 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 11:09:31.369232 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:09:31.382831 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:09:31.433731 tst handover.py: using LAC 27988 11:09:31.561910 tst handover.py: using RAC 193 11:09:31.687135 tst handover.py: using CellId 27988 11:09:31.845247 tst handover.py: using BVCI 27989 11:09:31.960501 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 11:09:32.006806 tst handover.py: using LAC 27989 11:09:32.169468 tst handover.py: using RAC 194 11:09:32.298846 tst handover.py: using CellId 27989 11:09:32.427286 tst handover.py: using BVCI 27990 11:09:32.546972 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:09:32.558530 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:09:32.569866 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:09:32.581333 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:09:32.592704 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 11:09:32.603990 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:09:32.718791 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 11:09:32.839532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:33.285564 run create_hlr_db(pid=763): Launched 11:09:33.403423 bus /sierra_2: Setting Powered False 11:09:34.463475 run create_hlr_db(pid=763): Terminated: ok {rc=0} 11:09:34.878566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=765): Launched 11:09:35.202243 run osmo-hlr_10.42.42.2(pid=766): Launched 11:09:35.326087 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:35.865764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=768): Launched 11:09:36.187842 run osmo-stp_10.42.42.5(pid=769): Launched 11:09:36.311750 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:36.867613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=771): Launched 11:09:37.189870 run osmo-msc_10.42.42.6(pid=772): Launched 11:09:37.370915 run osmo-stp_10.42.42.5(pid=769): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=769)] 11:09:37.507637 run osmo-stp_10.42.42.5(pid=769): stdout: | (launched: 2022-12-10_11:09:36.129969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:37.645502 run osmo-stp_10.42.42.5(pid=769): stderr: | 20221210110936321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110936322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110936322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110936322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110936323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110936323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110936323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:37.781518 run osmo-stp_10.42.42.5(pid=769): stdout: | (launched: 2022-12-10_11:09:36.129969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:37.910427 run osmo-stp_10.42.42.5(pid=769): stderr: | 20221210110936321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110936322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110936322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110936322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110936323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110936323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110936323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:38.064867 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=769): Process ended prematurely: osmo-stp_10.42.42.5(pid=769) [trial-2373↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=769)] [trial-2373↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 11:09:38.073969 tst handover.py:18: Test FAILED (6.7 sec) 11:09:38.101691 run osmo-hlr_10.42.42.2(pid=766): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=766)] 11:09:38.152029 run osmo-hlr_10.42.42.2(pid=766): stdout: | (launched: 2022-12-10_11:09:35.144237) 11:09:38.204026 run osmo-hlr_10.42.42.2(pid=766): stderr: | 20221210110935342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110935342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110935342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110935342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110935342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110935342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110935357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110935366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110935366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110935366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:38.276448 run osmo-msc_10.42.42.6(pid=772): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=772)] 11:09:38.326501 run osmo-msc_10.42.42.6(pid=772): stdout: | (launched: 2022-12-10_11:09:37.131858) 11:09:38.378417 run osmo-msc_10.42.42.6(pid=772): stderr: | 20221210110937451 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110937452 DLGLOBAL DEBUG validating counter group 0x7f01f8050c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110937452 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110937452 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110937452 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110937452 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110937454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110937454 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110937455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110937455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:38.430603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=765): Terminating (SIGTERM) 11:09:38.472424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=768): Terminating (SIGTERM) 11:09:38.514748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=771): Terminating (SIGTERM) 11:09:38.557285 --- ParallelTerminationStrategy: PID 765 died... 11:09:38.577329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=765): Terminated: ok {rc=0} 11:09:38.623677 --- ParallelTerminationStrategy: PID 768 died... 11:09:38.643409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=768): Terminated: ok {rc=0} 11:09:38.689530 --- ParallelTerminationStrategy: PID 771 died... 11:09:38.709222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=771): Terminated: ok {rc=0} 11:09:38.797279 bus /sierra_3: Setting Powered False 11:09:39.896090 bus /sierra_3: Setting Powered False 11:09:41.009926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:09:42.282783 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:42.289236 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:09:42.354359 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:09:42.381303 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:09:42.435641 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:09:42.499879 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:09:42.527020 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:09:43.075881 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:09:43.081389 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:09:43.092402 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:09:43.141113 tst handover.py: using LAC 27990 11:09:43.260082 tst handover.py: using RAC 195 11:09:43.378975 tst handover.py: using CellId 27990 11:09:43.499846 tst handover.py: using BVCI 27991 11:09:43.609725 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:09:43.659069 tst handover.py: using LAC 27991 11:09:43.779966 tst handover.py: using RAC 196 11:09:43.898761 tst handover.py: using CellId 27991 11:09:44.019722 tst handover.py: using BVCI 27992 11:09:44.138747 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:09:44.150244 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:09:44.161586 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:09:44.172872 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:09:44.184326 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:09:44.195587 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:09:44.310752 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:09:44.431692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:44.878298 run create_hlr_db(pid=777): Launched 11:09:44.994845 bus /sierra_2: Setting Powered False 11:09:46.083519 run create_hlr_db(pid=777): Terminated: ok {rc=0} 11:09:46.545752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=779): Launched 11:09:46.891514 run osmo-hlr_10.42.42.2(pid=780): Launched 11:09:47.186062 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:47.693634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=782): Launched 11:09:47.997599 run osmo-stp_10.42.42.5(pid=783): Launched 11:09:48.113227 run osmo-msc_10.42.42.6: Starting osmo-msc 11:09:48.635522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=785): Launched 11:09:48.938960 run osmo-msc_10.42.42.6(pid=786): Launched 11:09:49.107880 run osmo-stp_10.42.42.5(pid=783): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=783)] 11:09:49.235850 run osmo-stp_10.42.42.5(pid=783): stdout: | (launched: 2022-12-10_11:09:47.942799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:49.363777 run osmo-stp_10.42.42.5(pid=783): stderr: | 20221210110948111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110948111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110948112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110948112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110948113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110948113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110948113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:49.490303 run osmo-stp_10.42.42.5(pid=783): stdout: | (launched: 2022-12-10_11:09:47.942799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:09:49.611467 run osmo-stp_10.42.42.5(pid=783): stderr: | 20221210110948111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110948111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110948112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110948112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110948113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110948113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110948113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:09:49.756158 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=783): Process ended prematurely: osmo-stp_10.42.42.5(pid=783) [trial-2373↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=783)] [trial-2373↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 11:09:49.764535 tst handover.py:18: Test FAILED (6.7 sec) 11:09:49.791331 run osmo-hlr_10.42.42.2(pid=780): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=780)] 11:09:49.839572 run osmo-hlr_10.42.42.2(pid=780): stdout: | (launched: 2022-12-10_11:09:46.823983) 11:09:49.889459 run osmo-hlr_10.42.42.2(pid=780): stderr: | 20221210110947069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110947069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110947070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110947070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110947070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110947070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110947089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110947112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110947112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110947113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:09:49.958800 run osmo-msc_10.42.42.6(pid=786): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=786)] 11:09:50.006874 run osmo-msc_10.42.42.6(pid=786): stdout: | (launched: 2022-12-10_11:09:48.883992) 11:09:50.056446 run osmo-msc_10.42.42.6(pid=786): stderr: | 20221210110949155 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210110949155 DLGLOBAL DEBUG validating counter group 0x7fa184a77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210110949155 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210110949155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210110949155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210110949156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210110949158 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210110949159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210110949159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210110949159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:09:50.106702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=779): Terminating (SIGTERM) 11:09:50.146843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=782): Terminating (SIGTERM) 11:09:50.187193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=785): Terminating (SIGTERM) 11:09:50.227567 --- ParallelTerminationStrategy: PID 779 died... 11:09:50.246785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=779): Terminated: ok {rc=0} 11:09:50.291648 --- ParallelTerminationStrategy: PID 782 died... 11:09:50.310277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=782): Terminated: ok {rc=0} 11:09:50.354692 --- ParallelTerminationStrategy: PID 785 died... 11:09:50.373658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=785): Terminated: ok {rc=0} 11:09:50.459356 bus /sierra_3: Setting Powered False 11:09:51.559935 bus /sierra_3: Setting Powered False 11:09:52.674236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 11:09:53.956224 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:09:53.962394 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:09:54.013348 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:09:54.039782 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:09:54.091056 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:09:54.141181 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:09:54.167789 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:09:54.719125 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 11:09:54.724294 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:54.735048 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:09:54.782167 tst handover.py: using LAC 27992 11:09:54.902351 tst handover.py: using RAC 197 11:09:55.020768 tst handover.py: using CellId 27992 11:09:55.138374 tst handover.py: using BVCI 27993 11:09:55.248137 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 11:09:55.281552 tst handover.py: using LAC 27993 11:09:55.407881 tst handover.py: using RAC 198 11:09:55.533664 tst handover.py: using CellId 27993 11:09:55.662893 tst handover.py: using BVCI 27994 11:09:55.774954 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:55.786021 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:55.796736 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:55.808201 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:55.819765 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:09:55.831058 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:09:55.951024 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 11:09:56.070716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:09:56.545162 run create_hlr_db(pid=791): Launched 11:09:56.676031 bus /sierra_2: Setting Powered False 11:09:57.740600 run create_hlr_db(pid=791): Terminated: ok {rc=0} 11:09:58.149555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=793): Launched 11:09:58.454038 run osmo-hlr_10.42.42.2(pid=794): Launched 11:09:58.571348 run osmo-stp_10.42.42.5: Starting osmo-stp 11:09:59.084623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=796): Launched 11:09:59.388136 run osmo-stp_10.42.42.5(pid=797): Launched 11:09:59.505194 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:00.029719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=799): Launched 11:10:00.333222 run osmo-msc_10.42.42.6(pid=800): Launched 11:10:00.504701 run osmo-stp_10.42.42.5(pid=797): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=797)] 11:10:00.634026 run osmo-stp_10.42.42.5(pid=797): stdout: | (launched: 2022-12-10_11:09:59.332761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:00.762014 run osmo-stp_10.42.42.5(pid=797): stderr: | 20221210110959503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110959503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110959504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110959504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110959504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110959505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110959505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:00.914412 run osmo-stp_10.42.42.5(pid=797): stdout: | (launched: 2022-12-10_11:09:59.332761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:01.046419 run osmo-stp_10.42.42.5(pid=797): stderr: | 20221210110959503 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210110959503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210110959504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210110959504 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210110959504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210110959505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210110959505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:01.205545 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=797): Process ended prematurely: osmo-stp_10.42.42.5(pid=797) [trial-2373↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=797)] [trial-2373↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 11:10:01.214820 tst handover.py:18: Test FAILED (6.5 sec) 11:10:01.243462 run osmo-hlr_10.42.42.2(pid=794): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=794)] 11:10:01.295376 run osmo-hlr_10.42.42.2(pid=794): stdout: | (launched: 2022-12-10_11:09:58.398614) 11:10:01.359636 run osmo-hlr_10.42.42.2(pid=794): stderr: | 20221210110958573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210110958573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210110958573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210110958573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210110958573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210110958573 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210110958586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210110958594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210110958594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210110958594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:01.437827 run osmo-msc_10.42.42.6(pid=800): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=800)] 11:10:01.492298 run osmo-msc_10.42.42.6(pid=800): stdout: | (launched: 2022-12-10_11:10:00.277805) 11:10:01.547311 run osmo-msc_10.42.42.6(pid=800): stderr: | 20221210111000547 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111000547 DLGLOBAL DEBUG validating counter group 0x7fdb09934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111000547 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111000547 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111000547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111000548 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111000549 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111000550 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111000550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111000550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:01.601941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=793): Terminating (SIGTERM) 11:10:01.645902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=796): Terminating (SIGTERM) 11:10:01.691597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=799): Terminating (SIGTERM) 11:10:01.738207 --- ParallelTerminationStrategy: PID 793 died... 11:10:01.758966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=793): Terminated: ok {rc=0} 11:10:01.808079 --- ParallelTerminationStrategy: PID 796 died... 11:10:01.828387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=796): Terminated: ok {rc=0} 11:10:01.878061 --- ParallelTerminationStrategy: PID 799 died... 11:10:01.898853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=799): Terminated: ok {rc=0} 11:10:01.989232 bus /sierra_3: Setting Powered False 11:10:03.086715 bus /sierra_3: Setting Powered False 11:10:04.203312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 11:10:05.457204 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:05.462345 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:10:05.524268 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:10:05.551801 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:10:05.603517 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:10:05.666117 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:10:05.692570 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:10:06.245893 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 11:10:06.252069 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:06.263848 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:10:06.311244 tst handover.py: using LAC 27994 11:10:06.430031 tst handover.py: using RAC 199 11:10:06.550128 tst handover.py: using CellId 27994 11:10:06.668680 tst handover.py: using BVCI 27995 11:10:06.778776 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:10:06.824845 tst handover.py: using LAC 27995 11:10:06.941341 tst handover.py: using RAC 200 11:10:07.057850 tst handover.py: using CellId 27995 11:10:07.178073 tst handover.py: using BVCI 27996 11:10:07.289831 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:07.300610 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:07.311240 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:07.322130 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:07.333053 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:07.343827 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:10:07.460455 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:10:07.577107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:08.022097 run create_hlr_db(pid=809): Launched 11:10:08.138012 bus /sierra_2: Setting Powered False 11:10:09.198813 run create_hlr_db(pid=809): Terminated: ok {rc=0} 11:10:09.614864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=811): Launched 11:10:09.939714 run osmo-hlr_10.42.42.2(pid=812): Launched 11:10:10.063746 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:10.597354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=814): Launched 11:10:10.920827 run osmo-stp_10.42.42.5(pid=815): Launched 11:10:11.044907 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:11.606191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=817): Launched 11:10:11.929951 run osmo-msc_10.42.42.6(pid=818): Launched 11:10:12.111127 run osmo-stp_10.42.42.5(pid=815): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=815)] 11:10:12.247641 run osmo-stp_10.42.42.5(pid=815): stdout: | (launched: 2022-12-10_11:10:10.862440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:12.384150 run osmo-stp_10.42.42.5(pid=815): stderr: | 20221210111011055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111011055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111011055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111011056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111011056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111011056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111011056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:12.520387 run osmo-stp_10.42.42.5(pid=815): stdout: | (launched: 2022-12-10_11:10:10.862440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:12.649544 run osmo-stp_10.42.42.5(pid=815): stderr: | 20221210111011055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111011055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111011055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111011056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111011056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111011056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111011056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:12.803835 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=815): Process ended prematurely: osmo-stp_10.42.42.5(pid=815) [trial-2373↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=815)] [trial-2373↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 11:10:12.812547 tst handover.py:18: Test FAILED (6.6 sec) 11:10:12.839976 run osmo-hlr_10.42.42.2(pid=812): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=812)] 11:10:12.890204 run osmo-hlr_10.42.42.2(pid=812): stdout: | (launched: 2022-12-10_11:10:09.881059) 11:10:12.942469 run osmo-hlr_10.42.42.2(pid=812): stderr: | 20221210111010078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111010078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111010078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111010078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111010078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111010078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111010090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111010098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111010099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111010099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:13.014681 run osmo-msc_10.42.42.6(pid=818): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=818)] 11:10:13.064900 run osmo-msc_10.42.42.6(pid=818): stdout: | (launched: 2022-12-10_11:10:11.871311) 11:10:13.116873 run osmo-msc_10.42.42.6(pid=818): stderr: | 20221210111012191 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111012191 DLGLOBAL DEBUG validating counter group 0x7ffba1045c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111012191 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111012191 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111012191 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111012192 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111012193 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111012194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111012194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111012194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:13.169404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=811): Terminating (SIGTERM) 11:10:13.211099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=814): Terminating (SIGTERM) 11:10:13.253145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=817): Terminating (SIGTERM) 11:10:13.295480 --- ParallelTerminationStrategy: PID 811 died... 11:10:13.315196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=811): Terminated: ok {rc=0} 11:10:13.361789 --- ParallelTerminationStrategy: PID 814 died... 11:10:13.381283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=814): Terminated: ok {rc=0} 11:10:13.427502 --- ParallelTerminationStrategy: PID 817 died... 11:10:13.447052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=817): Terminated: ok {rc=0} 11:10:13.535559 bus /sierra_3: Setting Powered False 11:10:14.634651 bus /sierra_3: Setting Powered False 11:10:15.750622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 11:10:17.064884 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:17.075627 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:10:17.166705 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:10:17.194879 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:10:17.249321 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:10:17.314115 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:10:17.341598 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:10:17.887482 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 11:10:17.892942 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:17.904207 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:10:17.951993 tst handover.py: using LAC 27996 11:10:18.072350 tst handover.py: using RAC 201 11:10:18.191076 tst handover.py: using CellId 27996 11:10:18.311300 tst handover.py: using BVCI 27997 11:10:18.423069 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:10:18.470051 tst handover.py: using LAC 27997 11:10:18.590667 tst handover.py: using RAC 202 11:10:18.710782 tst handover.py: using CellId 27997 11:10:18.829600 tst handover.py: using BVCI 27998 11:10:18.941928 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:18.952710 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:18.963471 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:18.974447 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:18.985336 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:10:18.996071 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:10:19.115182 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:10:19.232747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:19.706467 run create_hlr_db(pid=825): Launched 11:10:19.838571 bus /sierra_2: Setting Powered False 11:10:20.902800 run create_hlr_db(pid=825): Terminated: ok {rc=0} 11:10:21.310086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=827): Launched 11:10:21.613179 run osmo-hlr_10.42.42.2(pid=828): Launched 11:10:21.731170 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:22.241706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=833): Launched 11:10:22.544421 run osmo-stp_10.42.42.5(pid=834): Launched 11:10:22.662176 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:23.184392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=836): Launched 11:10:23.487175 run osmo-msc_10.42.42.6(pid=837): Launched 11:10:23.657395 run osmo-stp_10.42.42.5(pid=834): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=834)] 11:10:23.784759 run osmo-stp_10.42.42.5(pid=834): stdout: | (launched: 2022-12-10_11:10:22.489297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:23.913272 run osmo-stp_10.42.42.5(pid=834): stderr: | 20221210111022659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111022659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111022659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111022660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111022660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111022660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111022660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:24.040082 run osmo-stp_10.42.42.5(pid=834): stdout: | (launched: 2022-12-10_11:10:22.489297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:24.161077 run osmo-stp_10.42.42.5(pid=834): stderr: | 20221210111022659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111022659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111022659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111022660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111022660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111022660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111022660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:24.305103 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=834): Process ended prematurely: osmo-stp_10.42.42.5(pid=834) [trial-2373↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=834)] [trial-2373↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 11:10:24.313272 tst handover.py:18: Test FAILED (6.4 sec) 11:10:24.339585 run osmo-hlr_10.42.42.2(pid=828): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=828)] 11:10:24.387866 run osmo-hlr_10.42.42.2(pid=828): stdout: | (launched: 2022-12-10_11:10:21.558024) 11:10:24.437438 run osmo-hlr_10.42.42.2(pid=828): stderr: | 20221210111021735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111021735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111021735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111021735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111021735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111021735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111021757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111021766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111021766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111021766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:24.506618 run osmo-msc_10.42.42.6(pid=837): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=837)] 11:10:24.554603 run osmo-msc_10.42.42.6(pid=837): stdout: | (launched: 2022-12-10_11:10:23.432103) 11:10:24.603929 run osmo-msc_10.42.42.6(pid=837): stderr: | 20221210111023704 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111023704 DLGLOBAL DEBUG validating counter group 0x7fc426ea9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111023704 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111023704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111023704 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111023704 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111023706 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111023706 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111023707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111023707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:24.653822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=827): Terminating (SIGTERM) 11:10:24.693720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=833): Terminating (SIGTERM) 11:10:24.733679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=836): Terminating (SIGTERM) 11:10:24.773768 --- ParallelTerminationStrategy: PID 827 died... 11:10:24.792825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=827): Terminated: ok {rc=0} 11:10:24.837132 --- ParallelTerminationStrategy: PID 833 died... 11:10:24.855656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=833): Terminated: ok {rc=0} 11:10:24.899937 --- ParallelTerminationStrategy: PID 836 died... 11:10:24.918550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=836): Terminated: ok {rc=0} 11:10:25.002373 bus /sierra_3: Setting Powered False 11:10:26.098231 bus /sierra_3: Setting Powered False 11:10:27.210997 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 11:10:28.475513 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:28.480630 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 11:10:28.539969 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:10:28.566630 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:10:28.620369 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 11:10:28.679846 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:10:28.706212 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:10:29.257202 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 11:10:29.262473 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:29.273814 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:10:29.317351 tst handover.py: using LAC 27998 11:10:29.434901 tst handover.py: using RAC 203 11:10:29.552733 tst handover.py: using CellId 27998 11:10:29.671456 tst handover.py: using BVCI 27999 11:10:29.790671 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 11:10:29.844260 tst handover.py: using LAC 27999 11:10:29.971845 tst handover.py: using RAC 204 11:10:30.097934 tst handover.py: using CellId 27999 11:10:30.222836 tst handover.py: using BVCI 28000 11:10:30.340480 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:30.352215 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:30.363740 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:30.375266 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:30.386729 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:10:30.398171 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:10:30.514369 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:10:30.628690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:31.109818 run create_hlr_db(pid=842): Launched 11:10:31.274486 bus /sierra_2: Setting Powered False 11:10:32.339455 run create_hlr_db(pid=842): Terminated: ok {rc=0} 11:10:32.747007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Launched 11:10:33.049978 run osmo-hlr_10.42.42.2(pid=846): Launched 11:10:33.166211 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:33.662155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Launched 11:10:33.965632 run osmo-stp_10.42.42.5(pid=849): Launched 11:10:34.082397 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:34.610102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=851): Launched 11:10:34.914400 run osmo-msc_10.42.42.6(pid=852): Launched 11:10:35.085997 run osmo-stp_10.42.42.5(pid=849): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] 11:10:35.215231 run osmo-stp_10.42.42.5(pid=849): stdout: | (launched: 2022-12-10_11:10:33.910389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:35.343873 run osmo-stp_10.42.42.5(pid=849): stderr: | 20221210111034080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111034080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111034080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111034081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111034081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111034081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111034081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:35.470278 run osmo-stp_10.42.42.5(pid=849): stdout: | (launched: 2022-12-10_11:10:33.910389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:35.591703 run osmo-stp_10.42.42.5(pid=849): stderr: | 20221210111034080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111034080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111034080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111034081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111034081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111034081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111034081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:35.736300 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=849): Process ended prematurely: osmo-stp_10.42.42.5(pid=849) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 11:10:35.744356 tst handover.py:18: Test FAILED (6.5 sec) 11:10:35.771306 run osmo-hlr_10.42.42.2(pid=846): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=846)] 11:10:35.819815 run osmo-hlr_10.42.42.2(pid=846): stdout: | (launched: 2022-12-10_11:10:32.994599) 11:10:35.869911 run osmo-hlr_10.42.42.2(pid=846): stderr: | 20221210111033171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111033171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111033171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111033171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111033171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111033171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111033187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111033197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111033197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111033197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:35.939555 run osmo-msc_10.42.42.6(pid=852): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=852)] 11:10:35.988233 run osmo-msc_10.42.42.6(pid=852): stdout: | (launched: 2022-12-10_11:10:34.859102) 11:10:36.037973 run osmo-msc_10.42.42.6(pid=852): stderr: | 20221210111035129 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111035129 DLGLOBAL DEBUG validating counter group 0x7f7824af0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111035129 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111035129 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111035129 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111035130 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111035131 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111035132 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111035132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111035132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:36.088239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Terminating (SIGTERM) 11:10:36.128602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Terminating (SIGTERM) 11:10:36.168909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=851): Terminating (SIGTERM) 11:10:36.209385 --- ParallelTerminationStrategy: PID 845 died... 11:10:36.228473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Terminated: ok {rc=0} 11:10:36.273606 --- ParallelTerminationStrategy: PID 848 died... 11:10:36.292242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Terminated: ok {rc=0} 11:10:36.337019 --- ParallelTerminationStrategy: PID 851 died... 11:10:36.355807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=851): Terminated: ok {rc=0} 11:10:36.441868 bus /sierra_3: Setting Powered False 11:10:37.541633 bus /sierra_3: Setting Powered False 11:10:38.658015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 11:10:39.935338 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:39.940835 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:10:39.989507 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:10:40.017087 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:10:40.072483 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:10:40.120498 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:10:40.147953 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:10:40.698006 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 11:10:40.703642 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:40.715102 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:10:40.760018 tst handover.py: using LAC 28000 11:10:40.887591 tst handover.py: using RAC 205 11:10:41.018608 tst handover.py: using CellId 28000 11:10:41.145485 tst handover.py: using BVCI 28001 11:10:41.262863 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 11:10:41.297435 tst handover.py: using LAC 28001 11:10:41.424692 tst handover.py: using RAC 206 11:10:41.550465 tst handover.py: using CellId 28001 11:10:41.675655 tst handover.py: using BVCI 28002 11:10:41.793345 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:41.804753 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:41.816059 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:41.827367 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:41.838717 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:10:41.850038 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:10:41.978574 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 11:10:42.095387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:42.541628 run create_hlr_db(pid=857): Launched 11:10:42.658448 bus /sierra_2: Setting Powered False 11:10:43.718909 run create_hlr_db(pid=857): Terminated: ok {rc=0} 11:10:44.133600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=859): Launched 11:10:44.459939 run osmo-hlr_10.42.42.2(pid=860): Launched 11:10:44.584913 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:45.118726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=862): Launched 11:10:45.443155 run osmo-stp_10.42.42.5(pid=863): Launched 11:10:45.567884 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:46.153755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=865): Launched 11:10:46.497731 run osmo-msc_10.42.42.6(pid=866): Launched 11:10:46.766523 run osmo-stp_10.42.42.5(pid=863): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=863)] 11:10:47.118300 run osmo-stp_10.42.42.5(pid=863): stdout: | (launched: 2022-12-10_11:10:45.384567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:47.425483 run osmo-stp_10.42.42.5(pid=863): stderr: | 20221210111045576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111045576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111045576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111045577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111045577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111045577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111045577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:47.616098 run osmo-stp_10.42.42.5(pid=863): stdout: | (launched: 2022-12-10_11:10:45.384567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:47.738196 run osmo-stp_10.42.42.5(pid=863): stderr: | 20221210111045576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111045576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111045576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111045577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111045577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111045577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111045577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:47.883273 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=863): Process ended prematurely: osmo-stp_10.42.42.5(pid=863) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=863)] [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 11:10:47.891456 tst handover.py:18: Test FAILED (7.2 sec) 11:10:47.918274 run osmo-hlr_10.42.42.2(pid=860): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=860)] 11:10:47.966782 run osmo-hlr_10.42.42.2(pid=860): stdout: | (launched: 2022-12-10_11:10:44.400647) 11:10:48.016803 run osmo-hlr_10.42.42.2(pid=860): stderr: | 20221210111044599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111044599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111044599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111044599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111044599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111044599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111044612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111044620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111044620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111044621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:48.086532 run osmo-msc_10.42.42.6(pid=866): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=866)] 11:10:48.134906 run osmo-msc_10.42.42.6(pid=866): stdout: | (launched: 2022-12-10_11:10:46.425972) 11:10:48.184897 run osmo-msc_10.42.42.6(pid=866): stderr: | 20221210111047150 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111047151 DLGLOBAL DEBUG validating counter group 0x7f960fc91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111047151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111047151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111047153 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111047154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111047165 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111047166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111047167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111047168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:48.235680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=859): Terminating (SIGTERM) 11:10:48.275880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=862): Terminating (SIGTERM) 11:10:48.316164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=865): Terminating (SIGTERM) 11:10:48.356795 --- ParallelTerminationStrategy: PID 859 died... 11:10:48.375742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=859): Terminated: ok {rc=0} 11:10:48.420401 --- ParallelTerminationStrategy: PID 862 died... 11:10:48.439201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=862): Terminated: ok {rc=0} 11:10:48.483935 --- ParallelTerminationStrategy: PID 865 died... 11:10:48.502745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=865): Terminated: ok {rc=0} 11:10:48.590152 bus /sierra_3: Setting Powered False 11:10:49.689632 bus /sierra_3: Setting Powered False 11:10:50.804859 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 11:10:52.055626 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:10:52.060709 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:10:52.119452 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:10:52.145888 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:10:52.199056 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:10:52.258341 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:10:52.284775 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:10:52.837121 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 11:10:52.842325 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:52.853416 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:10:52.897306 tst handover.py: using LAC 28002 11:10:53.018094 tst handover.py: using RAC 207 11:10:53.138681 tst handover.py: using CellId 28002 11:10:53.258777 tst handover.py: using BVCI 28003 11:10:53.369985 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:10:53.418086 tst handover.py: using LAC 28003 11:10:53.538936 tst handover.py: using RAC 208 11:10:53.659548 tst handover.py: using CellId 28003 11:10:53.788018 tst handover.py: using BVCI 28004 11:10:53.907171 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:53.918941 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:53.930542 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:53.942470 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:53.954366 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:10:53.966036 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:10:54.079961 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:10:54.199092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:10:54.674356 run create_hlr_db(pid=871): Launched 11:10:54.805948 bus /sierra_2: Setting Powered False 11:10:55.870640 run create_hlr_db(pid=871): Terminated: ok {rc=0} 11:10:56.293998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=887): Launched 11:10:56.619039 run osmo-hlr_10.42.42.2(pid=888): Launched 11:10:56.743271 run osmo-stp_10.42.42.5: Starting osmo-stp 11:10:57.276262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=890): Launched 11:10:57.601911 run osmo-stp_10.42.42.5(pid=891): Launched 11:10:57.725972 run osmo-msc_10.42.42.6: Starting osmo-msc 11:10:58.286890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=893): Launched 11:10:58.611327 run osmo-msc_10.42.42.6(pid=894): Launched 11:10:58.791882 run osmo-stp_10.42.42.5(pid=891): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=891)] 11:10:58.928268 run osmo-stp_10.42.42.5(pid=891): stdout: | (launched: 2022-12-10_11:10:57.542037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:59.065189 run osmo-stp_10.42.42.5(pid=891): stderr: | 20221210111057735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111057735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111057736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111057736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111057737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111057737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111057737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:59.200521 run osmo-stp_10.42.42.5(pid=891): stdout: | (launched: 2022-12-10_11:10:57.542037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:10:59.329230 run osmo-stp_10.42.42.5(pid=891): stderr: | 20221210111057735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111057735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111057736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111057736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111057737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111057737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111057737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:10:59.483110 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=891): Process ended prematurely: osmo-stp_10.42.42.5(pid=891) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=891)] [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 11:10:59.491758 tst handover.py:18: Test FAILED (6.6 sec) 11:10:59.519328 run osmo-hlr_10.42.42.2(pid=888): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=888)] 11:10:59.569330 run osmo-hlr_10.42.42.2(pid=888): stdout: | (launched: 2022-12-10_11:10:56.560371) 11:10:59.620619 run osmo-hlr_10.42.42.2(pid=888): stderr: | 20221210111056760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111056760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111056760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111056760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111056760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111056760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111056773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111056781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111056781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111056781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:10:59.692363 run osmo-msc_10.42.42.6(pid=894): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=894)] 11:10:59.742281 run osmo-msc_10.42.42.6(pid=894): stdout: | (launched: 2022-12-10_11:10:58.552737) 11:10:59.793205 run osmo-msc_10.42.42.6(pid=894): stderr: | 20221210111058872 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111058872 DLGLOBAL DEBUG validating counter group 0x7f97960d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111058872 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111058872 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111058873 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111058873 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111058874 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111058875 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111058875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111058875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:10:59.844643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=887): Terminating (SIGTERM) 11:10:59.886043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=890): Terminating (SIGTERM) 11:10:59.927669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=893): Terminating (SIGTERM) 11:10:59.969473 --- ParallelTerminationStrategy: PID 887 died... 11:10:59.989356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=887): Terminated: ok {rc=0} 11:11:00.035073 --- ParallelTerminationStrategy: PID 890 died... 11:11:00.054504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=890): Terminated: ok {rc=0} 11:11:00.100248 --- ParallelTerminationStrategy: PID 893 died... 11:11:00.119609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=893): Terminated: ok {rc=0} 11:11:00.206752 bus /sierra_3: Setting Powered False 11:11:01.303791 bus /sierra_3: Setting Powered False 11:11:02.422320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 11:11:03.690042 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:03.696732 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:11:03.756729 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:11:03.784274 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:11:03.839408 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:11:03.899499 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:11:03.926698 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:11:04.480641 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 11:11:04.486093 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:04.497647 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:04.542991 tst handover.py: using LAC 28004 11:11:04.669744 tst handover.py: using RAC 209 11:11:04.791027 tst handover.py: using CellId 28004 11:11:04.912100 tst handover.py: using BVCI 28005 11:11:05.023897 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:05.071623 tst handover.py: using LAC 28005 11:11:05.192043 tst handover.py: using RAC 210 11:11:05.312016 tst handover.py: using CellId 28005 11:11:05.432036 tst handover.py: using BVCI 28006 11:11:05.543992 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:05.555033 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:05.565950 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:05.577201 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:05.588294 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:05.599301 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:05.714713 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:05.832469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:06.305760 run create_hlr_db(pid=899): Launched 11:11:06.438808 bus /sierra_2: Setting Powered False 11:11:07.502764 run create_hlr_db(pid=899): Terminated: ok {rc=0} 11:11:07.926031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=901): Launched 11:11:08.249933 run osmo-hlr_10.42.42.2(pid=902): Launched 11:11:08.374276 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:08.903378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=904): Launched 11:11:09.227090 run osmo-stp_10.42.42.5(pid=905): Launched 11:11:09.351148 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:09.910268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=907): Launched 11:11:10.233663 run osmo-msc_10.42.42.6(pid=908): Launched 11:11:10.415786 run osmo-stp_10.42.42.5(pid=905): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=905)] 11:11:10.552653 run osmo-stp_10.42.42.5(pid=905): stdout: | (launched: 2022-12-10_11:11:09.168465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:10.689545 run osmo-stp_10.42.42.5(pid=905): stderr: | 20221210111109360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111109360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111109360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111109361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111109361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111109361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111109361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:10.825199 run osmo-stp_10.42.42.5(pid=905): stdout: | (launched: 2022-12-10_11:11:09.168465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:10.954244 run osmo-stp_10.42.42.5(pid=905): stderr: | 20221210111109360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111109360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111109360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111109361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111109361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111109361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111109361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:11.108647 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=905): Process ended prematurely: osmo-stp_10.42.42.5(pid=905) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=905)] [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 11:11:11.117465 tst handover.py:18: Test FAILED (6.6 sec) 11:11:11.144929 run osmo-hlr_10.42.42.2(pid=902): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=902)] 11:11:11.195173 run osmo-hlr_10.42.42.2(pid=902): stdout: | (launched: 2022-12-10_11:11:08.191383) 11:11:11.247092 run osmo-hlr_10.42.42.2(pid=902): stderr: | 20221210111108388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111108389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111108389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111108389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111108389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111108389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111108401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111108409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111108410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111108410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:11.319567 run osmo-msc_10.42.42.6(pid=908): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=908)] 11:11:11.369833 run osmo-msc_10.42.42.6(pid=908): stdout: | (launched: 2022-12-10_11:11:10.175110) 11:11:11.421560 run osmo-msc_10.42.42.6(pid=908): stderr: | 20221210111110497 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111110497 DLGLOBAL DEBUG validating counter group 0x7fbc2e73ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111110497 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111110498 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111110498 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111110498 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111110499 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111110500 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111110500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111110500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:11.473541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=901): Terminating (SIGTERM) 11:11:11.515376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=904): Terminating (SIGTERM) 11:11:11.557740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=907): Terminating (SIGTERM) 11:11:11.600200 --- ParallelTerminationStrategy: PID 901 died... 11:11:11.620024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=901): Terminated: ok {rc=0} 11:11:11.666371 --- ParallelTerminationStrategy: PID 904 died... 11:11:11.685895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=904): Terminated: ok {rc=0} 11:11:11.731676 --- ParallelTerminationStrategy: PID 907 died... 11:11:11.751174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=907): Terminated: ok {rc=0} 11:11:11.839114 bus /sierra_3: Setting Powered False 11:11:12.938343 bus /sierra_3: Setting Powered False 11:11:14.053879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 11:11:15.326183 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:15.332006 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 11:11:15.384907 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 11:11:15.412598 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 11:11:15.468044 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 11:11:15.520678 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 11:11:15.548452 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 11:11:16.099835 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 11:11:16.106574 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:16.118549 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:11:16.176197 tst handover.py: using LAC 28006 11:11:16.297795 tst handover.py: using RAC 211 11:11:16.419698 tst handover.py: using CellId 28006 11:11:16.582397 tst handover.py: using BVCI 28007 11:11:16.737344 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 11:11:16.777330 tst handover.py: using LAC 28007 11:11:16.900804 tst handover.py: using RAC 212 11:11:17.022523 tst handover.py: using CellId 28007 11:11:17.142695 tst handover.py: using BVCI 28008 11:11:17.260781 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:17.272380 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:17.283843 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:17.297088 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:17.308350 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 11:11:17.319645 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:11:17.440678 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 11:11:17.556073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:18.001745 run create_hlr_db(pid=913): Launched 11:11:18.118139 bus /sierra_2: Setting Powered False 11:11:19.178848 run create_hlr_db(pid=913): Terminated: ok {rc=0} 11:11:19.577545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=915): Launched 11:11:19.882792 run osmo-hlr_10.42.42.2(pid=916): Launched 11:11:19.998689 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:20.508931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=918): Launched 11:11:20.812748 run osmo-stp_10.42.42.5(pid=919): Launched 11:11:20.930078 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:21.453715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=921): Launched 11:11:21.758674 run osmo-msc_10.42.42.6(pid=922): Launched 11:11:21.928562 run osmo-stp_10.42.42.5(pid=919): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=919)] 11:11:22.057224 run osmo-stp_10.42.42.5(pid=919): stdout: | (launched: 2022-12-10_11:11:20.757552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:22.185811 run osmo-stp_10.42.42.5(pid=919): stderr: | 20221210111120927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111120928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111120928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111120928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111120929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111120929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111120929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:22.311920 run osmo-stp_10.42.42.5(pid=919): stdout: | (launched: 2022-12-10_11:11:20.757552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:22.432108 run osmo-stp_10.42.42.5(pid=919): stderr: | 20221210111120927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111120928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111120928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111120928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111120929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111120929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111120929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:22.576707 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=919): Process ended prematurely: osmo-stp_10.42.42.5(pid=919) [trial-2373↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=919)] [trial-2373↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 11:11:22.584885 tst handover.py:18: Test FAILED (6.5 sec) 11:11:22.611526 run osmo-hlr_10.42.42.2(pid=916): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=916)] 11:11:22.659386 run osmo-hlr_10.42.42.2(pid=916): stdout: | (launched: 2022-12-10_11:11:19.827144) 11:11:22.708769 run osmo-hlr_10.42.42.2(pid=916): stderr: | 20221210111120004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111120004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111120004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111120004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111120004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111120004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111120016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111120025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111120025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111120025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:22.777759 run osmo-msc_10.42.42.6(pid=922): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=922)] 11:11:22.825767 run osmo-msc_10.42.42.6(pid=922): stdout: | (launched: 2022-12-10_11:11:21.703157) 11:11:22.875367 run osmo-msc_10.42.42.6(pid=922): stderr: | 20221210111121973 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111121973 DLGLOBAL DEBUG validating counter group 0x7f05e821ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111121973 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111121973 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111121973 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111121973 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111121975 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111121975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111121976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111121976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:22.925334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=915): Terminating (SIGTERM) 11:11:22.965196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=918): Terminating (SIGTERM) 11:11:23.005454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=921): Terminating (SIGTERM) 11:11:23.045871 --- ParallelTerminationStrategy: PID 915 died... 11:11:23.065100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=915): Terminated: ok {rc=0} 11:11:23.110434 --- ParallelTerminationStrategy: PID 918 died... 11:11:23.129199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=918): Terminated: ok {rc=0} 11:11:23.173588 --- ParallelTerminationStrategy: PID 921 died... 11:11:23.192315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=921): Terminated: ok {rc=0} 11:11:23.276782 bus /sierra_3: Setting Powered False 11:11:24.375013 bus /sierra_3: Setting Powered False 11:11:25.490547 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 11:11:26.748004 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:26.753133 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:11:26.816265 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:11:26.842902 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:11:26.896215 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:11:26.964181 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:11:26.991507 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:11:27.539924 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 11:11:27.546013 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:27.557656 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:27.609144 tst handover.py: using LAC 28008 11:11:27.736875 tst handover.py: using RAC 213 11:11:27.863120 tst handover.py: using CellId 28008 11:11:27.988885 tst handover.py: using BVCI 28009 11:11:28.106181 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:28.155786 tst handover.py: using LAC 28009 11:11:28.276860 tst handover.py: using RAC 214 11:11:28.399512 tst handover.py: using CellId 28009 11:11:28.517574 tst handover.py: using BVCI 28010 11:11:28.628291 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:28.639293 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:28.650202 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:28.661398 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:28.672788 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:28.683881 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:28.801280 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:28.920265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:29.394674 run create_hlr_db(pid=927): Launched 11:11:29.525542 bus /sierra_2: Setting Powered False 11:11:30.590861 run create_hlr_db(pid=927): Terminated: ok {rc=0} 11:11:31.015163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=929): Launched 11:11:31.357545 run osmo-hlr_10.42.42.2(pid=930): Launched 11:11:31.640932 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:32.230349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=932): Launched 11:11:32.541566 run osmo-stp_10.42.42.5(pid=933): Launched 11:11:32.660421 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:33.187755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=936): Launched 11:11:33.493249 run osmo-msc_10.42.42.6(pid=937): Launched 11:11:33.664860 run osmo-stp_10.42.42.5(pid=933): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=933)] 11:11:33.794369 run osmo-stp_10.42.42.5(pid=933): stdout: | (launched: 2022-12-10_11:11:32.486577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:33.923565 run osmo-stp_10.42.42.5(pid=933): stderr: | 20221210111132655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111132655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111132655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111132656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111132656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111132656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111132656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:34.050380 run osmo-stp_10.42.42.5(pid=933): stdout: | (launched: 2022-12-10_11:11:32.486577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:34.171643 run osmo-stp_10.42.42.5(pid=933): stderr: | 20221210111132655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111132655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111132655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111132656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111132656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111132656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111132656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:34.316885 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=933): Process ended prematurely: osmo-stp_10.42.42.5(pid=933) [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=933)] [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 11:11:34.325142 tst handover.py:18: Test FAILED (6.8 sec) 11:11:34.351852 run osmo-hlr_10.42.42.2(pid=930): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=930)] 11:11:34.399682 run osmo-hlr_10.42.42.2(pid=930): stdout: | (launched: 2022-12-10_11:11:31.286955) 11:11:34.449354 run osmo-hlr_10.42.42.2(pid=930): stderr: | 20221210111131496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111131496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111131496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111131496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111131496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111131497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111131510 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111131532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111131532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111131532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:34.518602 run osmo-msc_10.42.42.6(pid=937): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=937)] 11:11:34.566985 run osmo-msc_10.42.42.6(pid=937): stdout: | (launched: 2022-12-10_11:11:33.437941) 11:11:34.616703 run osmo-msc_10.42.42.6(pid=937): stderr: | 20221210111133711 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111133711 DLGLOBAL DEBUG validating counter group 0x7fd64751ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111133712 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111133712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111133712 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111133712 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111133714 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111133714 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111133714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111133714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:34.666458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=929): Terminating (SIGTERM) 11:11:34.706105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=932): Terminating (SIGTERM) 11:11:34.746078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=936): Terminating (SIGTERM) 11:11:34.786257 --- ParallelTerminationStrategy: PID 929 died... 11:11:34.805253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=929): Terminated: ok {rc=0} 11:11:34.849658 --- ParallelTerminationStrategy: PID 932 died... 11:11:34.868404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=932): Terminated: ok {rc=0} 11:11:34.913269 --- ParallelTerminationStrategy: PID 936 died... 11:11:34.931804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=936): Terminated: ok {rc=0} 11:11:35.018754 bus /sierra_3: Setting Powered False 11:11:36.121214 bus /sierra_3: Setting Powered False 11:11:37.234929 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 11:11:38.511358 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:38.517092 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:11:38.583038 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:11:38.610944 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:11:38.666517 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:11:38.731235 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:11:38.758539 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:11:39.305962 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 11:11:39.311387 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:39.322540 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:39.370655 tst handover.py: using LAC 28010 11:11:39.490647 tst handover.py: using RAC 215 11:11:39.611701 tst handover.py: using CellId 28010 11:11:39.730586 tst handover.py: using BVCI 28011 11:11:39.842459 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:11:39.889771 tst handover.py: using LAC 28011 11:11:40.012426 tst handover.py: using RAC 216 11:11:40.132412 tst handover.py: using CellId 28011 11:11:40.251471 tst handover.py: using BVCI 28012 11:11:40.363245 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:40.374263 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:40.385213 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:40.396234 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:40.407345 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:11:40.418453 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:40.538098 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:11:40.654158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:41.097485 run create_hlr_db(pid=942): Launched 11:11:41.213419 bus /sierra_2: Setting Powered False 11:11:42.274236 run create_hlr_db(pid=942): Terminated: ok {rc=0} 11:11:42.671574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=944): Launched 11:11:42.975102 run osmo-hlr_10.42.42.2(pid=945): Launched 11:11:43.091717 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:43.599917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=947): Launched 11:11:43.905166 run osmo-stp_10.42.42.5(pid=948): Launched 11:11:44.022172 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:44.546402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=950): Launched 11:11:44.850945 run osmo-msc_10.42.42.6(pid=951): Launched 11:11:45.021641 run osmo-stp_10.42.42.5(pid=948): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=948)] 11:11:45.150311 run osmo-stp_10.42.42.5(pid=948): stdout: | (launched: 2022-12-10_11:11:43.849659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:45.278484 run osmo-stp_10.42.42.5(pid=948): stderr: | 20221210111144019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111144019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111144019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111144020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111144020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111144020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111144020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:45.405240 run osmo-stp_10.42.42.5(pid=948): stdout: | (launched: 2022-12-10_11:11:43.849659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:45.525916 run osmo-stp_10.42.42.5(pid=948): stderr: | 20221210111144019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111144019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111144019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111144020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111144020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111144020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111144020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:45.670535 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=948): Process ended prematurely: osmo-stp_10.42.42.5(pid=948) [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=948)] [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 11:11:45.678676 tst handover.py:18: Test FAILED (6.4 sec) 11:11:45.704916 run osmo-hlr_10.42.42.2(pid=945): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=945)] 11:11:45.752711 run osmo-hlr_10.42.42.2(pid=945): stdout: | (launched: 2022-12-10_11:11:42.920114) 11:11:45.801922 run osmo-hlr_10.42.42.2(pid=945): stderr: | 20221210111143095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111143095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111143095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111143095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111143095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111143095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111143107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111143116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111143116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111143116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:45.871629 run osmo-msc_10.42.42.6(pid=951): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=951)] 11:11:45.920933 run osmo-msc_10.42.42.6(pid=951): stdout: | (launched: 2022-12-10_11:11:44.795523) 11:11:45.972609 run osmo-msc_10.42.42.6(pid=951): stderr: | 20221210111145065 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111145066 DLGLOBAL DEBUG validating counter group 0x7f800fd62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111145066 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111145066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111145066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111145066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111145068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111145068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111145068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111145069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:46.024472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=944): Terminating (SIGTERM) 11:11:46.066273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=947): Terminating (SIGTERM) 11:11:46.108886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=950): Terminating (SIGTERM) 11:11:46.152786 --- ParallelTerminationStrategy: PID 944 died... 11:11:46.172634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=944): Terminated: ok {rc=0} 11:11:46.220291 --- ParallelTerminationStrategy: PID 947 died... 11:11:46.240076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=947): Terminated: ok {rc=0} 11:11:46.287459 --- ParallelTerminationStrategy: PID 950 died... 11:11:46.307106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=950): Terminated: ok {rc=0} 11:11:46.398671 bus /sierra_3: Setting Powered False 11:11:47.506626 bus /sierra_3: Setting Powered False 11:11:48.622736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 11:11:49.895452 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:11:49.900358 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 11:11:49.951202 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 11:11:49.977937 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 11:11:50.031393 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 11:11:50.082550 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 11:11:50.109071 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 11:11:50.659230 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 11:11:50.664465 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:50.675233 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:50.710405 tst handover.py: using LAC 28012 11:11:50.839076 tst handover.py: using RAC 217 11:11:50.966457 tst handover.py: using CellId 28012 11:11:51.096096 tst handover.py: using BVCI 28013 11:11:51.215572 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 11:11:51.265728 tst handover.py: using LAC 28013 11:11:51.393669 tst handover.py: using RAC 218 11:11:51.520050 tst handover.py: using CellId 28013 11:11:51.647831 tst handover.py: using BVCI 28014 11:11:51.765660 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:51.776876 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:51.788010 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:51.799617 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:51.811295 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 11:11:51.822906 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:51.940013 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 11:11:52.059179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:11:52.534338 run create_hlr_db(pid=958): Launched 11:11:52.667328 bus /sierra_2: Setting Powered False 11:11:53.731893 run create_hlr_db(pid=958): Terminated: ok {rc=0} 11:11:54.155058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Launched 11:11:54.479429 run osmo-hlr_10.42.42.2(pid=961): Launched 11:11:54.604654 run osmo-stp_10.42.42.5: Starting osmo-stp 11:11:55.134912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=963): Launched 11:11:55.459746 run osmo-stp_10.42.42.5(pid=964): Launched 11:11:55.585292 run osmo-msc_10.42.42.6: Starting osmo-msc 11:11:56.143771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=966): Launched 11:11:56.467454 run osmo-msc_10.42.42.6(pid=967): Launched 11:11:56.649481 run osmo-stp_10.42.42.5(pid=964): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=964)] 11:11:56.786889 run osmo-stp_10.42.42.5(pid=964): stdout: | (launched: 2022-12-10_11:11:55.400876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:56.924125 run osmo-stp_10.42.42.5(pid=964): stderr: | 20221210111155595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111155595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111155595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111155596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111155596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111155596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111155596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:57.060001 run osmo-stp_10.42.42.5(pid=964): stdout: | (launched: 2022-12-10_11:11:55.400876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:11:57.189129 run osmo-stp_10.42.42.5(pid=964): stderr: | 20221210111155595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111155595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111155595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111155596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111155596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111155596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111155596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:11:57.343732 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=964): Process ended prematurely: osmo-stp_10.42.42.5(pid=964) [trial-2373↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=964)] [trial-2373↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 11:11:57.352450 tst handover.py:18: Test FAILED (6.7 sec) 11:11:57.379889 run osmo-hlr_10.42.42.2(pid=961): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=961)] 11:11:57.430204 run osmo-hlr_10.42.42.2(pid=961): stdout: | (launched: 2022-12-10_11:11:54.420808) 11:11:57.483050 run osmo-hlr_10.42.42.2(pid=961): stderr: | 20221210111154618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111154618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111154618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111154618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111154618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111154618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111154635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111154643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111154643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111154643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:11:57.555953 run osmo-msc_10.42.42.6(pid=967): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=967)] 11:11:57.606737 run osmo-msc_10.42.42.6(pid=967): stdout: | (launched: 2022-12-10_11:11:56.408791) 11:11:57.659259 run osmo-msc_10.42.42.6(pid=967): stderr: | 20221210111156731 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111156732 DLGLOBAL DEBUG validating counter group 0x7fbefb189c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111156732 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111156732 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111156732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111156732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111156734 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111156734 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111156735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111156735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:11:57.711689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Terminating (SIGTERM) 11:11:57.753749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=963): Terminating (SIGTERM) 11:11:57.795963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=966): Terminating (SIGTERM) 11:11:57.838379 --- ParallelTerminationStrategy: PID 960 died... 11:11:57.858569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=960): Terminated: ok {rc=0} 11:11:57.905268 --- ParallelTerminationStrategy: PID 963 died... 11:11:57.924865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=963): Terminated: ok {rc=0} 11:11:57.971191 --- ParallelTerminationStrategy: PID 966 died... 11:11:57.990884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=966): Terminated: ok {rc=0} 11:11:58.079092 bus /sierra_3: Setting Powered False 11:11:59.178865 bus /sierra_3: Setting Powered False 11:12:00.295776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 11:12:01.590478 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:01.598938 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:12:01.662370 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:12:01.697368 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:12:01.763240 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:12:01.841031 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:12:01.871975 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:12:02.402984 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 11:12:02.408338 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:02.419596 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:12:02.468341 tst handover.py: using LAC 28014 11:12:02.601412 tst handover.py: using RAC 219 11:12:02.730840 tst handover.py: using CellId 28014 11:12:02.860011 tst handover.py: using BVCI 28015 11:12:02.979618 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:12:03.029368 tst handover.py: using LAC 28015 11:12:03.157451 tst handover.py: using RAC 220 11:12:03.284344 tst handover.py: using CellId 28015 11:12:03.412497 tst handover.py: using BVCI 28016 11:12:03.524576 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:03.535430 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:03.546053 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:03.556801 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:03.567984 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:03.578833 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:12:03.693195 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:12:03.812866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:04.288645 run create_hlr_db(pid=972): Launched 11:12:04.420726 bus /sierra_2: Setting Powered False 11:12:05.485650 run create_hlr_db(pid=972): Terminated: ok {rc=0} 11:12:05.894764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=974): Launched 11:12:06.198916 run osmo-hlr_10.42.42.2(pid=975): Launched 11:12:06.315546 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:06.814536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=977): Launched 11:12:07.119476 run osmo-stp_10.42.42.5(pid=978): Launched 11:12:07.236758 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:07.762514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=980): Launched 11:12:08.066803 run osmo-msc_10.42.42.6(pid=981): Launched 11:12:08.238207 run osmo-stp_10.42.42.5(pid=978): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=978)] 11:12:08.367246 run osmo-stp_10.42.42.5(pid=978): stdout: | (launched: 2022-12-10_11:12:07.063878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:08.495874 run osmo-stp_10.42.42.5(pid=978): stderr: | 20221210111207234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111207234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111207234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111207235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111207235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111207235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111207235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:08.622722 run osmo-stp_10.42.42.5(pid=978): stdout: | (launched: 2022-12-10_11:12:07.063878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:08.744203 run osmo-stp_10.42.42.5(pid=978): stderr: | 20221210111207234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111207234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111207234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111207235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111207235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111207235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111207235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:08.890143 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=978): Process ended prematurely: osmo-stp_10.42.42.5(pid=978) [trial-2373↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=978)] [trial-2373↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 11:12:08.898496 tst handover.py:18: Test FAILED (6.5 sec) 11:12:08.925378 run osmo-hlr_10.42.42.2(pid=975): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=975)] 11:12:08.974010 run osmo-hlr_10.42.42.2(pid=975): stdout: | (launched: 2022-12-10_11:12:06.143595) 11:12:09.023846 run osmo-hlr_10.42.42.2(pid=975): stderr: | 20221210111206319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111206319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111206319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111206319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111206319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111206319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111206332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111206342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111206342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111206342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:09.093605 run osmo-msc_10.42.42.6(pid=981): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=981)] 11:12:09.141903 run osmo-msc_10.42.42.6(pid=981): stdout: | (launched: 2022-12-10_11:12:08.011206) 11:12:09.191796 run osmo-msc_10.42.42.6(pid=981): stderr: | 20221210111208281 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111208281 DLGLOBAL DEBUG validating counter group 0x7f64d1f7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111208281 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111208281 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111208282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111208282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111208283 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111208284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111208284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111208284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:09.242567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=974): Terminating (SIGTERM) 11:12:09.282954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=977): Terminating (SIGTERM) 11:12:09.323503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=980): Terminating (SIGTERM) 11:12:09.364201 --- ParallelTerminationStrategy: PID 974 died... 11:12:09.383484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=974): Terminated: ok {rc=0} 11:12:09.428557 --- ParallelTerminationStrategy: PID 977 died... 11:12:09.447505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=977): Terminated: ok {rc=0} 11:12:09.492438 --- ParallelTerminationStrategy: PID 980 died... 11:12:09.511383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=980): Terminated: ok {rc=0} 11:12:09.598053 bus /sierra_3: Setting Powered False 11:12:10.698977 bus /sierra_3: Setting Powered False 11:12:11.817675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2373 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 11:12:13.070173 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:12:13.076749 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 11:12:13.140729 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:12:13.168279 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 11:12:13.223431 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 11:12:13.288503 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:12:13.315890 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 11:12:13.864771 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2373 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 11:12:13.870191 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:13.881530 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:12:13.930727 tst handover.py: using LAC 28016 11:12:14.060519 tst handover.py: using RAC 221 11:12:14.190315 tst handover.py: using CellId 28016 11:12:14.310375 tst handover.py: using BVCI 28017 11:12:14.420623 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 11:12:14.467086 tst handover.py: using LAC 28017 11:12:14.586771 tst handover.py: using RAC 222 11:12:14.706222 tst handover.py: using CellId 28017 11:12:14.833363 tst handover.py: using BVCI 28018 11:12:14.954633 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:14.966046 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:14.977433 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:14.989216 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:15.000840 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 11:12:15.012496 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:12:15.130410 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 11:12:15.246696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:12:15.692585 run create_hlr_db(pid=986): Launched 11:12:15.809222 bus /sierra_2: Setting Powered False 11:12:16.868519 run create_hlr_db(pid=986): Terminated: ok {rc=0} 11:12:17.282783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=989): Launched 11:12:17.588340 run osmo-hlr_10.42.42.2(pid=990): Launched 11:12:17.705911 run osmo-stp_10.42.42.5: Starting osmo-stp 11:12:18.202342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=996): Launched 11:12:18.505574 run osmo-stp_10.42.42.5(pid=997): Launched 11:12:18.622641 run osmo-msc_10.42.42.6: Starting osmo-msc 11:12:19.150483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=999): Launched 11:12:19.454996 run osmo-msc_10.42.42.6(pid=1000): Launched 11:12:19.626187 run osmo-stp_10.42.42.5(pid=997): ERR: Terminated: ERROR {rc=1} [trial-2373↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=997)] 11:12:19.755271 run osmo-stp_10.42.42.5(pid=997): stdout: | (launched: 2022-12-10_11:12:18.450302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:19.884356 run osmo-stp_10.42.42.5(pid=997): stderr: | 20221210111218621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111218621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111218622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111218622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111218623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111218623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111218623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:20.011434 run osmo-stp_10.42.42.5(pid=997): stdout: | (launched: 2022-12-10_11:12:18.450302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:12:20.132650 run osmo-stp_10.42.42.5(pid=997): stderr: | 20221210111218621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210111218621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210111218622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210111218622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210111218623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210111218623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210111218623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:12:20.278218 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=997): Process ended prematurely: osmo-stp_10.42.42.5(pid=997) [trial-2373↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=997)] [trial-2373↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 11:12:20.286401 tst handover.py:18: Test FAILED (6.4 sec) 11:12:20.313188 run osmo-hlr_10.42.42.2(pid=990): ERR: Terminated: ERROR {rc=237} [trial-2373↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=990)] 11:12:20.361218 run osmo-hlr_10.42.42.2(pid=990): stdout: | (launched: 2022-12-10_11:12:17.533065) 11:12:20.410982 run osmo-hlr_10.42.42.2(pid=990): stderr: | 20221210111217710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210111217710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210111217710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210111217710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210111217710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210111217710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210111217728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210111217738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210111217738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210111217738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:12:20.480337 run osmo-msc_10.42.42.6(pid=1000): ERR: Terminated: ERROR {rc=2} [trial-2373↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1000)] 11:12:20.528304 run osmo-msc_10.42.42.6(pid=1000): stdout: | (launched: 2022-12-10_11:12:19.399669) 11:12:20.578090 run osmo-msc_10.42.42.6(pid=1000): stderr: | 20221210111219672 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210111219672 DLGLOBAL DEBUG validating counter group 0x7f6719303c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210111219672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210111219672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210111219672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210111219672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210111219674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210111219674 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210111219675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210111219675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:12:20.628330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=989): Terminating (SIGTERM) 11:12:20.668326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=996): Terminating (SIGTERM) 11:12:20.708348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=999): Terminating (SIGTERM) 11:12:20.748894 --- ParallelTerminationStrategy: PID 989 died... 11:12:20.768207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=989): Terminated: ok {rc=0} 11:12:20.813066 --- ParallelTerminationStrategy: PID 996 died... 11:12:20.831689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=996): Terminated: ok {rc=0} 11:12:20.876266 --- ParallelTerminationStrategy: PID 999 died... 11:12:20.895177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=999): Terminated: ok {rc=0} 11:12:20.982564 bus /sierra_3: Setting Powered False 11:12:22.081942 bus /sierra_3: Setting Powered False 11:12:23.196799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2373 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 11:12:24.464675 tst trial-2373: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/trial-2373.xml -------------------------------------------------------------------------------------------- trial-2373 FAIL -------------------------------------------------------------------------------------------- 11:12:26.389560 tst trial-2373: trial-2373: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.7 sec) Error: osmo-nitb_10.42.42.2(pid=25531): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25531) [trial-2373↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25531)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.0 sec) Error: osmo-stp_10.42.42.5(pid=25543): Process ended prematurely: osmo-stp_10.42.42.5(pid=25543) [trial-2373↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25543)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25552) [trial-2373↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25552)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=25578): Process ended prematurely: osmo-stp_10.42.42.5(pid=25578) [trial-2373↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25578)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25593): Process ended prematurely: osmo-stp_10.42.42.5(pid=25593) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25593)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25604): Process ended prematurely: osmo-stp_10.42.42.5(pid=25604) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25604)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25618): Process ended prematurely: osmo-stp_10.42.42.5(pid=25618) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25618)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25629): Process ended prematurely: osmo-stp_10.42.42.5(pid=25629) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25629)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25643): Process ended prematurely: osmo-stp_10.42.42.5(pid=25643) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25643)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25654): Process ended prematurely: osmo-stp_10.42.42.5(pid=25654) [trial-2373↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25654)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25668): Process ended prematurely: osmo-stp_10.42.42.5(pid=25668) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25668)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25679): Process ended prematurely: osmo-stp_10.42.42.5(pid=25679) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25679)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25693): Process ended prematurely: osmo-stp_10.42.42.5(pid=25693) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25693)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25705): Process ended prematurely: osmo-stp_10.42.42.5(pid=25705) [trial-2373↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25705)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25719): Process ended prematurely: osmo-stp_10.42.42.5(pid=25719) [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25719)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25730): Process ended prematurely: osmo-stp_10.42.42.5(pid=25730) [trial-2373↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25730)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25744): Process ended prematurely: osmo-stp_10.42.42.5(pid=25744) [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25744)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=26026): Process ended prematurely: osmo-stp_10.42.42.5(pid=26026) [trial-2373↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26026)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=26040): Process ended prematurely: osmo-stp_10.42.42.5(pid=26040) [trial-2373↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26040)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26052): Process ended prematurely: osmo-stp_10.42.42.5(pid=26052) [trial-2373↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26052)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=26071): Process ended prematurely: osmo-stp_10.42.42.5(pid=26071) [trial-2373↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26071)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=26083): Process ended prematurely: osmo-stp_10.42.42.5(pid=26083) [trial-2373↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26083)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26101): Process ended prematurely: osmo-stp_10.42.42.5(pid=26101) [trial-2373↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26101)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26111): Process ended prematurely: osmo-stp_10.42.42.5(pid=26111) [trial-2373↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26111)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26121): Process ended prematurely: osmo-stp_10.42.42.5(pid=26121) [trial-2373↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26121)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26142): Process ended prematurely: osmo-stp_10.42.42.5(pid=26142) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26142)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=26155): Process ended prematurely: osmo-stp_10.42.42.5(pid=26155) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26155)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26173): Process ended prematurely: osmo-stp_10.42.42.5(pid=26173) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26173)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26183): Process ended prematurely: osmo-stp_10.42.42.5(pid=26183) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26183)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26193): Process ended prematurely: osmo-stp_10.42.42.5(pid=26193) [trial-2373↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26193)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26211): Process ended prematurely: osmo-stp_10.42.42.5(pid=26211) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26211)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26223): Process ended prematurely: osmo-stp_10.42.42.5(pid=26223) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26223)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26241): Process ended prematurely: osmo-stp_10.42.42.5(pid=26241) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26241)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26251): Process ended prematurely: osmo-stp_10.42.42.5(pid=26251) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26251)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26261): Process ended prematurely: osmo-stp_10.42.42.5(pid=26261) [trial-2373↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26261)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26279): Process ended prematurely: osmo-stp_10.42.42.5(pid=26279) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26279)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26291): Process ended prematurely: osmo-stp_10.42.42.5(pid=26291) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26291)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26309): Process ended prematurely: osmo-stp_10.42.42.5(pid=26309) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26309)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26323): Process ended prematurely: osmo-stp_10.42.42.5(pid=26323) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26323)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26333): Process ended prematurely: osmo-stp_10.42.42.5(pid=26333) [trial-2373↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26333)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26346): Process ended prematurely: osmo-stp_10.42.42.5(pid=26346) [trial-2373↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26346)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26359): Process ended prematurely: osmo-stp_10.42.42.5(pid=26359) [trial-2373↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26359)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26367): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26367) [trial-2373↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26367)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26377): Process ended prematurely: osmo-stp_10.42.42.5(pid=26377) [trial-2373↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26377)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26386): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26386) [trial-2373↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26386)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=26396): Process ended prematurely: osmo-stp_10.42.42.5(pid=26396) [trial-2373↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26396)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26411): Process ended prematurely: osmo-stp_10.42.42.5(pid=26411) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26422): Process ended prematurely: osmo-stp_10.42.42.5(pid=26422) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26422)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26436): Process ended prematurely: osmo-stp_10.42.42.5(pid=26436) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26436)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26447): Process ended prematurely: osmo-stp_10.42.42.5(pid=26447) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26447)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26461): Process ended prematurely: osmo-stp_10.42.42.5(pid=26461) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26461)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26472): Process ended prematurely: osmo-stp_10.42.42.5(pid=26472) [trial-2373↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26472)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26489): Process ended prematurely: osmo-stp_10.42.42.5(pid=26489) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26489)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26500): Process ended prematurely: osmo-stp_10.42.42.5(pid=26500) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26500)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26514): Process ended prematurely: osmo-stp_10.42.42.5(pid=26514) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26514)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26525): Process ended prematurely: osmo-stp_10.42.42.5(pid=26525) [trial-2373↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26540): Process ended prematurely: osmo-stp_10.42.42.5(pid=26540) [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26540)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26551): Process ended prematurely: osmo-stp_10.42.42.5(pid=26551) [trial-2373↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26551)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26565): Process ended prematurely: osmo-stp_10.42.42.5(pid=26565) [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26576): Process ended prematurely: osmo-stp_10.42.42.5(pid=26576) [trial-2373↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26576)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26590): Process ended prematurely: osmo-stp_10.42.42.5(pid=26590) [trial-2373↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26590)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26601): Process ended prematurely: osmo-stp_10.42.42.5(pid=26601) [trial-2373↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26601)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26619): Process ended prematurely: osmo-stp_10.42.42.5(pid=26619) [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26619)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26631): Process ended prematurely: osmo-stp_10.42.42.5(pid=26631) [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26649): Process ended prematurely: osmo-stp_10.42.42.5(pid=26649) [trial-2373↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26649)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26660): Process ended prematurely: osmo-stp_10.42.42.5(pid=26660) [trial-2373↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26660)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26670): Process ended prematurely: osmo-stp_10.42.42.5(pid=26670) [trial-2373↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26670)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26688): Process ended prematurely: osmo-stp_10.42.42.5(pid=26688) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26688)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26701): Process ended prematurely: osmo-stp_10.42.42.5(pid=26701) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26701)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=26724): Process ended prematurely: osmo-stp_10.42.42.5(pid=26724) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26724)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26734): Process ended prematurely: osmo-stp_10.42.42.5(pid=26734) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26734)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26744): Process ended prematurely: osmo-stp_10.42.42.5(pid=26744) [trial-2373↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26744)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=26761): Process ended prematurely: osmo-stp_10.42.42.5(pid=26761) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26761)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26773): Process ended prematurely: osmo-stp_10.42.42.5(pid=26773) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26773)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26792): Process ended prematurely: osmo-stp_10.42.42.5(pid=26792) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26792)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26802): Process ended prematurely: osmo-stp_10.42.42.5(pid=26802) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26802)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26813): Process ended prematurely: osmo-stp_10.42.42.5(pid=26813) [trial-2373↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26813)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26832): Process ended prematurely: osmo-stp_10.42.42.5(pid=26832) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26832)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=26847): Process ended prematurely: osmo-stp_10.42.42.5(pid=26847) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26847)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26865): Process ended prematurely: osmo-stp_10.42.42.5(pid=26865) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26865)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26875): Process ended prematurely: osmo-stp_10.42.42.5(pid=26875) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26875)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26885): Process ended prematurely: osmo-stp_10.42.42.5(pid=26885) [trial-2373↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26885)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26898): Process ended prematurely: osmo-stp_10.42.42.5(pid=26898) [trial-2373↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26898)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26911): Process ended prematurely: osmo-stp_10.42.42.5(pid=26911) [trial-2373↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26911)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26919): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26919) [trial-2373↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26919)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=26929): Process ended prematurely: osmo-stp_10.42.42.5(pid=26929) [trial-2373↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26929)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26938) [trial-2373↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26938)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26948): Process ended prematurely: osmo-stp_10.42.42.5(pid=26948) [trial-2373↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26948)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26962): Process ended prematurely: osmo-stp_10.42.42.5(pid=26962) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26962)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26973): Process ended prematurely: osmo-stp_10.42.42.5(pid=26973) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26973)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26987): Process ended prematurely: osmo-stp_10.42.42.5(pid=26987) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26987)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26998): Process ended prematurely: osmo-stp_10.42.42.5(pid=26998) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26998)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27013): Process ended prematurely: osmo-stp_10.42.42.5(pid=27013) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27013)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27025): Process ended prematurely: osmo-stp_10.42.42.5(pid=27025) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27025)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27039): Process ended prematurely: osmo-stp_10.42.42.5(pid=27039) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27039)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27050): Process ended prematurely: osmo-stp_10.42.42.5(pid=27050) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27050)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=27064): Process ended prematurely: osmo-stp_10.42.42.5(pid=27064) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27064)] FAIL: mo_mt_call_osmux.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=27347): Process ended prematurely: osmo-stp_10.42.42.5(pid=27347) [trial-2373↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27347)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27361): Process ended prematurely: osmo-stp_10.42.42.5(pid=27361) [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27361)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27372): Process ended prematurely: osmo-stp_10.42.42.5(pid=27372) [trial-2373↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27372)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27386): Process ended prematurely: osmo-stp_10.42.42.5(pid=27386) [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27386)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27397): Process ended prematurely: osmo-stp_10.42.42.5(pid=27397) [trial-2373↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27397)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27412): Process ended prematurely: osmo-stp_10.42.42.5(pid=27412) [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27412)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27423): Process ended prematurely: osmo-stp_10.42.42.5(pid=27423) [trial-2373↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27438): Process ended prematurely: osmo-stp_10.42.42.5(pid=27438) [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27438)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27449): Process ended prematurely: osmo-stp_10.42.42.5(pid=27449) [trial-2373↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27449)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27467): Process ended prematurely: osmo-stp_10.42.42.5(pid=27467) [trial-2373↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27467)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27478): Process ended prematurely: osmo-stp_10.42.42.5(pid=27478) [trial-2373↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27478)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27496): Process ended prematurely: osmo-stp_10.42.42.5(pid=27496) [trial-2373↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27496)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=27508): Process ended prematurely: osmo-stp_10.42.42.5(pid=27508) [trial-2373↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=27526): Process ended prematurely: osmo-stp_10.42.42.5(pid=27526) [trial-2373↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27526)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27536): Process ended prematurely: osmo-stp_10.42.42.5(pid=27536) [trial-2373↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27536)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27546): Process ended prematurely: osmo-stp_10.42.42.5(pid=27546) [trial-2373↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27546)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=27565): Process ended prematurely: osmo-stp_10.42.42.5(pid=27565) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27565)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=27577): Process ended prematurely: osmo-stp_10.42.42.5(pid=27577) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27577)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=27595): Process ended prematurely: osmo-stp_10.42.42.5(pid=27595) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27595)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27605): Process ended prematurely: osmo-stp_10.42.42.5(pid=27605) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27615): Process ended prematurely: osmo-stp_10.42.42.5(pid=27615) [trial-2373↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27615)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27632): Process ended prematurely: osmo-stp_10.42.42.5(pid=27632) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27632)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27645): Process ended prematurely: osmo-stp_10.42.42.5(pid=27645) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27645)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=27663): Process ended prematurely: osmo-stp_10.42.42.5(pid=27663) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27663)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27673): Process ended prematurely: osmo-stp_10.42.42.5(pid=27673) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27673)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27683): Process ended prematurely: osmo-stp_10.42.42.5(pid=27683) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27683)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=27700): Process ended prematurely: osmo-stp_10.42.42.5(pid=27700) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27700)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=27712): Process ended prematurely: osmo-stp_10.42.42.5(pid=27712) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27712)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=27730): Process ended prematurely: osmo-stp_10.42.42.5(pid=27730) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27730)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27740): Process ended prematurely: osmo-stp_10.42.42.5(pid=27740) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27740)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27751): Process ended prematurely: osmo-stp_10.42.42.5(pid=27751) [trial-2373↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27751)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27769): Process ended prematurely: osmo-stp_10.42.42.5(pid=27769) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27769)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=27781): Process ended prematurely: osmo-stp_10.42.42.5(pid=27781) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27781)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=27799): Process ended prematurely: osmo-stp_10.42.42.5(pid=27799) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27799)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27812): Process ended prematurely: osmo-stp_10.42.42.5(pid=27812) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27812)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27822): Process ended prematurely: osmo-stp_10.42.42.5(pid=27822) [trial-2373↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27822)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27835): Process ended prematurely: osmo-stp_10.42.42.5(pid=27835) [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27848): Process ended prematurely: osmo-stp_10.42.42.5(pid=27848) [trial-2373↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27848)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27856): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27856) [trial-2373↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27856)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27868): Process ended prematurely: osmo-stp_10.42.42.5(pid=27868) [trial-2373↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27868)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=27877): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27877) [trial-2373↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27877)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27887): Process ended prematurely: osmo-stp_10.42.42.5(pid=27887) [trial-2373↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27887)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27901): Process ended prematurely: osmo-stp_10.42.42.5(pid=27901) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27901)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27912): Process ended prematurely: osmo-stp_10.42.42.5(pid=27912) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27912)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27926): Process ended prematurely: osmo-stp_10.42.42.5(pid=27926) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27926)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27937): Process ended prematurely: osmo-stp_10.42.42.5(pid=27937) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27937)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27954): Process ended prematurely: osmo-stp_10.42.42.5(pid=27954) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27954)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27965): Process ended prematurely: osmo-stp_10.42.42.5(pid=27965) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27965)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27979): Process ended prematurely: osmo-stp_10.42.42.5(pid=27979) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27979)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27992): Process ended prematurely: osmo-stp_10.42.42.5(pid=27992) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27992)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28007): Process ended prematurely: osmo-stp_10.42.42.5(pid=28007) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28007)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28018): Process ended prematurely: osmo-stp_10.42.42.5(pid=28018) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28018)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28032): Process ended prematurely: osmo-stp_10.42.42.5(pid=28032) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28032)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28043): Process ended prematurely: osmo-stp_10.42.42.5(pid=28043) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28043)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28057): Process ended prematurely: osmo-stp_10.42.42.5(pid=28057) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28057)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28068): Process ended prematurely: osmo-stp_10.42.42.5(pid=28068) [trial-2373↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28068)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28082): Process ended prematurely: osmo-stp_10.42.42.5(pid=28082) [trial-2373↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28082)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28093): Process ended prematurely: osmo-stp_10.42.42.5(pid=28093) [trial-2373↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28093)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=28113): Process ended prematurely: osmo-stp_10.42.42.5(pid=28113) [trial-2373↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28113)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28125): Process ended prematurely: osmo-stp_10.42.42.5(pid=28125) [trial-2373↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28125)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28144): Process ended prematurely: osmo-stp_10.42.42.5(pid=28144) [trial-2373↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28144)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28157): Process ended prematurely: osmo-stp_10.42.42.5(pid=28157) [trial-2373↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28157)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28167): Process ended prematurely: osmo-stp_10.42.42.5(pid=28167) [trial-2373↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28167)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=28184): Process ended prematurely: osmo-stp_10.42.42.5(pid=28184) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28184)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28196): Process ended prematurely: osmo-stp_10.42.42.5(pid=28196) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=28214): Process ended prematurely: osmo-stp_10.42.42.5(pid=28214) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28214)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28224): Process ended prematurely: osmo-stp_10.42.42.5(pid=28224) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28224)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28234): Process ended prematurely: osmo-stp_10.42.42.5(pid=28234) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28234)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=28253): Process ended prematurely: osmo-stp_10.42.42.5(pid=28253) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28253)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28265): Process ended prematurely: osmo-stp_10.42.42.5(pid=28265) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28265)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=28283): Process ended prematurely: osmo-stp_10.42.42.5(pid=28283) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28283)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28293): Process ended prematurely: osmo-stp_10.42.42.5(pid=28293) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28293)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28303): Process ended prematurely: osmo-stp_10.42.42.5(pid=28303) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28303)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28321): Process ended prematurely: osmo-stp_10.42.42.5(pid=28321) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28321)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=28334): Process ended prematurely: osmo-stp_10.42.42.5(pid=28334) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28334)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28352): Process ended prematurely: osmo-stp_10.42.42.5(pid=28352) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28352)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28362): Process ended prematurely: osmo-stp_10.42.42.5(pid=28362) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28362)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28372): Process ended prematurely: osmo-stp_10.42.42.5(pid=28372) [trial-2373↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28372)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=28657): Process ended prematurely: osmo-stp_10.42.42.5(pid=28657) [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28657)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28670): Process ended prematurely: osmo-stp_10.42.42.5(pid=28670) [trial-2373↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28670)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=28680): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28680) [trial-2373↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28680)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28692): Process ended prematurely: osmo-stp_10.42.42.5(pid=28692) [trial-2373↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28692)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28701): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28701) [trial-2373↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28701)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=28711): Process ended prematurely: osmo-stp_10.42.42.5(pid=28711) [trial-2373↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28711)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28725): Process ended prematurely: osmo-stp_10.42.42.5(pid=28725) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28725)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28736): Process ended prematurely: osmo-stp_10.42.42.5(pid=28736) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28736)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28750): Process ended prematurely: osmo-stp_10.42.42.5(pid=28750) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28750)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28761): Process ended prematurely: osmo-stp_10.42.42.5(pid=28761) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28761)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28778): Process ended prematurely: osmo-stp_10.42.42.5(pid=28778) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28778)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28789): Process ended prematurely: osmo-stp_10.42.42.5(pid=28789) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28789)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28804): Process ended prematurely: osmo-stp_10.42.42.5(pid=28804) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28804)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28815): Process ended prematurely: osmo-stp_10.42.42.5(pid=28815) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28815)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28830): Process ended prematurely: osmo-stp_10.42.42.5(pid=28830) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28841): Process ended prematurely: osmo-stp_10.42.42.5(pid=28841) [trial-2373↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28841)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28855): Process ended prematurely: osmo-stp_10.42.42.5(pid=28855) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28855)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28866): Process ended prematurely: osmo-stp_10.42.42.5(pid=28866) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28866)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28880): Process ended prematurely: osmo-stp_10.42.42.5(pid=28880) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28880)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28891): Process ended prematurely: osmo-stp_10.42.42.5(pid=28891) [trial-2373↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28891)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28905): Process ended prematurely: osmo-stp_10.42.42.5(pid=28905) [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28916): Process ended prematurely: osmo-stp_10.42.42.5(pid=28916) [trial-2373↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28916)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28930): Process ended prematurely: osmo-stp_10.42.42.5(pid=28930) [trial-2373↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28930)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28941): Process ended prematurely: osmo-stp_10.42.42.5(pid=28941) [trial-2373↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28941)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28965): Process ended prematurely: osmo-stp_10.42.42.5(pid=28965) [trial-2373↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28965)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28977): Process ended prematurely: osmo-stp_10.42.42.5(pid=28977) [trial-2373↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28977)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=28995): Process ended prematurely: osmo-stp_10.42.42.5(pid=28995) [trial-2373↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28995)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29005): Process ended prematurely: osmo-stp_10.42.42.5(pid=29005) [trial-2373↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29005)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29015): Process ended prematurely: osmo-stp_10.42.42.5(pid=29015) [trial-2373↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29015)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29032): Process ended prematurely: osmo-stp_10.42.42.5(pid=29032) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29045): Process ended prematurely: osmo-stp_10.42.42.5(pid=29045) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29045)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29063): Process ended prematurely: osmo-stp_10.42.42.5(pid=29063) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29063)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29073): Process ended prematurely: osmo-stp_10.42.42.5(pid=29073) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29073)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29083): Process ended prematurely: osmo-stp_10.42.42.5(pid=29083) [trial-2373↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29083)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29101): Process ended prematurely: osmo-stp_10.42.42.5(pid=29101) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29101)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29113): Process ended prematurely: osmo-stp_10.42.42.5(pid=29113) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29113)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=29134): Process ended prematurely: osmo-stp_10.42.42.5(pid=29134) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29134)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29171): Process ended prematurely: osmo-stp_10.42.42.5(pid=29171) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29171)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29183): Process ended prematurely: osmo-stp_10.42.42.5(pid=29183) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29183)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=29201): Process ended prematurely: osmo-stp_10.42.42.5(pid=29201) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29201)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29211): Process ended prematurely: osmo-stp_10.42.42.5(pid=29211) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29211)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29221): Process ended prematurely: osmo-stp_10.42.42.5(pid=29221) [trial-2373↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29221)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=29238): Process ended prematurely: osmo-stp_10.42.42.5(pid=29238) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29238)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29250): Process ended prematurely: osmo-stp_10.42.42.5(pid=29250) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29250)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29268): Process ended prematurely: osmo-stp_10.42.42.5(pid=29268) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29268)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29278): Process ended prematurely: osmo-stp_10.42.42.5(pid=29278) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29278)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29288): Process ended prematurely: osmo-stp_10.42.42.5(pid=29288) [trial-2373↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29288)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29304): Process ended prematurely: osmo-stp_10.42.42.5(pid=29304) [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29317): Process ended prematurely: osmo-stp_10.42.42.5(pid=29317) [trial-2373↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29317)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29325): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29325) [trial-2373↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29325)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29336): Process ended prematurely: osmo-stp_10.42.42.5(pid=29336) [trial-2373↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29345): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29345) [trial-2373↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29345)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=29355): Process ended prematurely: osmo-stp_10.42.42.5(pid=29355) [trial-2373↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29355)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29369): Process ended prematurely: osmo-stp_10.42.42.5(pid=29369) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29369)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29380): Process ended prematurely: osmo-stp_10.42.42.5(pid=29380) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29380)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29394): Process ended prematurely: osmo-stp_10.42.42.5(pid=29394) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29394)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29406): Process ended prematurely: osmo-stp_10.42.42.5(pid=29406) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29406)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29420): Process ended prematurely: osmo-stp_10.42.42.5(pid=29420) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29420)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29431): Process ended prematurely: osmo-stp_10.42.42.5(pid=29431) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29445): Process ended prematurely: osmo-stp_10.42.42.5(pid=29445) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29445)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29456): Process ended prematurely: osmo-stp_10.42.42.5(pid=29456) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29456)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29484): Process ended prematurely: osmo-stp_10.42.42.5(pid=29484) [trial-2373↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29498): Process ended prematurely: osmo-stp_10.42.42.5(pid=29498) [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29498)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29509): Process ended prematurely: osmo-stp_10.42.42.5(pid=29509) [trial-2373↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29509)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29523): Process ended prematurely: osmo-stp_10.42.42.5(pid=29523) [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29523)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29534): Process ended prematurely: osmo-stp_10.42.42.5(pid=29534) [trial-2373↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29534)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29548): Process ended prematurely: osmo-stp_10.42.42.5(pid=29548) [trial-2373↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29548)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29559): Process ended prematurely: osmo-stp_10.42.42.5(pid=29559) [trial-2373↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29559)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29577): Process ended prematurely: osmo-stp_10.42.42.5(pid=29577) [trial-2373↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29589): Process ended prematurely: osmo-stp_10.42.42.5(pid=29589) [trial-2373↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29589)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29607): Process ended prematurely: osmo-stp_10.42.42.5(pid=29607) [trial-2373↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29607)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29617): Process ended prematurely: osmo-stp_10.42.42.5(pid=29617) [trial-2373↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29617)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29627): Process ended prematurely: osmo-stp_10.42.42.5(pid=29627) [trial-2373↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29644): Process ended prematurely: osmo-stp_10.42.42.5(pid=29644) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29644)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29657): Process ended prematurely: osmo-stp_10.42.42.5(pid=29657) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29657)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29675): Process ended prematurely: osmo-stp_10.42.42.5(pid=29675) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29675)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29685): Process ended prematurely: osmo-stp_10.42.42.5(pid=29685) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29685)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29967): Process ended prematurely: osmo-stp_10.42.42.5(pid=29967) [trial-2373↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29967)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=29984): Process ended prematurely: osmo-stp_10.42.42.5(pid=29984) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29984)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=29997): Process ended prematurely: osmo-stp_10.42.42.5(pid=29997) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29997)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=30015): Process ended prematurely: osmo-stp_10.42.42.5(pid=30015) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30015)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30026): Process ended prematurely: osmo-stp_10.42.42.5(pid=30026) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30026)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30036): Process ended prematurely: osmo-stp_10.42.42.5(pid=30036) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30036)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=30053): Process ended prematurely: osmo-stp_10.42.42.5(pid=30053) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30053)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30065): Process ended prematurely: osmo-stp_10.42.42.5(pid=30065) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30065)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30096): Process ended prematurely: osmo-stp_10.42.42.5(pid=30096) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30096)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30106): Process ended prematurely: osmo-stp_10.42.42.5(pid=30106) [trial-2373↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30106)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30121): Process ended prematurely: osmo-stp_10.42.42.5(pid=30121) [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30121)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30134): Process ended prematurely: osmo-stp_10.42.42.5(pid=30134) [trial-2373↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30134)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30143): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30143) [trial-2373↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30143)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30154): Process ended prematurely: osmo-stp_10.42.42.5(pid=30154) [trial-2373↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30154)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30163): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30163) [trial-2373↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30163)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30173): Process ended prematurely: osmo-stp_10.42.42.5(pid=30173) [trial-2373↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30173)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30187): Process ended prematurely: osmo-stp_10.42.42.5(pid=30187) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30187)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30198): Process ended prematurely: osmo-stp_10.42.42.5(pid=30198) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30198)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30212): Process ended prematurely: osmo-stp_10.42.42.5(pid=30212) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30212)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30223): Process ended prematurely: osmo-stp_10.42.42.5(pid=30223) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30223)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30240): Process ended prematurely: osmo-stp_10.42.42.5(pid=30240) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30240)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30266): Process ended prematurely: osmo-stp_10.42.42.5(pid=30266) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30266)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30279): Process ended prematurely: osmo-stp_10.42.42.5(pid=30279) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30279)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30293): Process ended prematurely: osmo-stp_10.42.42.5(pid=30293) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30293)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30304): Process ended prematurely: osmo-stp_10.42.42.5(pid=30304) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30304)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30318): Process ended prematurely: osmo-stp_10.42.42.5(pid=30318) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30318)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30329): Process ended prematurely: osmo-stp_10.42.42.5(pid=30329) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30329)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30343): Process ended prematurely: osmo-stp_10.42.42.5(pid=30343) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30343)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30355): Process ended prematurely: osmo-stp_10.42.42.5(pid=30355) [trial-2373↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30355)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30369): Process ended prematurely: osmo-stp_10.42.42.5(pid=30369) [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30369)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30380): Process ended prematurely: osmo-stp_10.42.42.5(pid=30380) [trial-2373↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30380)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30399): Process ended prematurely: osmo-stp_10.42.42.5(pid=30399) [trial-2373↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30399)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30411): Process ended prematurely: osmo-stp_10.42.42.5(pid=30411) [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30411)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=30429): Process ended prematurely: osmo-stp_10.42.42.5(pid=30429) [trial-2373↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30429)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30442): Process ended prematurely: osmo-stp_10.42.42.5(pid=30442) [trial-2373↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30442)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30452): Process ended prematurely: osmo-stp_10.42.42.5(pid=30452) [trial-2373↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30452)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30471): Process ended prematurely: osmo-stp_10.42.42.5(pid=30471) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30471)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30483): Process ended prematurely: osmo-stp_10.42.42.5(pid=30483) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30483)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30501): Process ended prematurely: osmo-stp_10.42.42.5(pid=30501) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30501)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30511): Process ended prematurely: osmo-stp_10.42.42.5(pid=30511) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30511)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30521): Process ended prematurely: osmo-stp_10.42.42.5(pid=30521) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30521)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30538): Process ended prematurely: osmo-stp_10.42.42.5(pid=30538) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30538)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30550): Process ended prematurely: osmo-stp_10.42.42.5(pid=30550) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30550)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30568): Process ended prematurely: osmo-stp_10.42.42.5(pid=30568) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30568)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30578): Process ended prematurely: osmo-stp_10.42.42.5(pid=30578) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30578)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30588): Process ended prematurely: osmo-stp_10.42.42.5(pid=30588) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30588)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30606): Process ended prematurely: osmo-stp_10.42.42.5(pid=30606) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30606)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=30618): Process ended prematurely: osmo-stp_10.42.42.5(pid=30618) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30618)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30636): Process ended prematurely: osmo-stp_10.42.42.5(pid=30636) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30636)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30646): Process ended prematurely: osmo-stp_10.42.42.5(pid=30646) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30646)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2373↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30669): Process ended prematurely: osmo-stp_10.42.42.5(pid=30669) [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30669)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30682): Process ended prematurely: osmo-stp_10.42.42.5(pid=30682) [trial-2373↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30682)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30690): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30690) [trial-2373↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30690)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=30700): Process ended prematurely: osmo-stp_10.42.42.5(pid=30700) [trial-2373↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30700)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30710): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30710) [trial-2373↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30710)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30720): Process ended prematurely: osmo-stp_10.42.42.5(pid=30720) [trial-2373↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30720)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30734): Process ended prematurely: osmo-stp_10.42.42.5(pid=30734) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30734)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30745): Process ended prematurely: osmo-stp_10.42.42.5(pid=30745) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30745)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30771): Process ended prematurely: osmo-stp_10.42.42.5(pid=30771) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30785): Process ended prematurely: osmo-stp_10.42.42.5(pid=30785) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30799): Process ended prematurely: osmo-stp_10.42.42.5(pid=30799) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30799)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30813): Process ended prematurely: osmo-stp_10.42.42.5(pid=30813) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30813)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30824): Process ended prematurely: osmo-stp_10.42.42.5(pid=30824) [trial-2373↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30824)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30838): Process ended prematurely: osmo-stp_10.42.42.5(pid=30838) [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30838)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30849): Process ended prematurely: osmo-stp_10.42.42.5(pid=30849) [trial-2373↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30849)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30863): Process ended prematurely: osmo-stp_10.42.42.5(pid=30863) [trial-2373↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30874): Process ended prematurely: osmo-stp_10.42.42.5(pid=30874) [trial-2373↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30874)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30892): Process ended prematurely: osmo-stp_10.42.42.5(pid=30892) [trial-2373↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30892)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30904): Process ended prematurely: osmo-stp_10.42.42.5(pid=30904) [trial-2373↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30922): Process ended prematurely: osmo-stp_10.42.42.5(pid=30922) [trial-2373↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30922)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30932): Process ended prematurely: osmo-stp_10.42.42.5(pid=30932) [trial-2373↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30942): Process ended prematurely: osmo-stp_10.42.42.5(pid=30942) [trial-2373↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30942)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30960): Process ended prematurely: osmo-stp_10.42.42.5(pid=30960) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30960)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=30973): Process ended prematurely: osmo-stp_10.42.42.5(pid=30973) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30991): Process ended prematurely: osmo-stp_10.42.42.5(pid=30991) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30991)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31001): Process ended prematurely: osmo-stp_10.42.42.5(pid=31001) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31001)] FAIL: ping_idle_ping.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=31282): Process ended prematurely: osmo-stp_10.42.42.5(pid=31282) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31282)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=31299): Process ended prematurely: osmo-stp_10.42.42.5(pid=31299) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31299)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=31311): Process ended prematurely: osmo-stp_10.42.42.5(pid=31311) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31311)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=31341): Process ended prematurely: osmo-stp_10.42.42.5(pid=31341) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31341)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31352): Process ended prematurely: osmo-stp_10.42.42.5(pid=31352) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31352)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31362): Process ended prematurely: osmo-stp_10.42.42.5(pid=31362) [trial-2373↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31362)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31375): Process ended prematurely: osmo-stp_10.42.42.5(pid=31375) [trial-2373↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31388): Process ended prematurely: osmo-stp_10.42.42.5(pid=31388) [trial-2373↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31388)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=31397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31397) [trial-2373↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31397)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=31407): Process ended prematurely: osmo-stp_10.42.42.5(pid=31407) [trial-2373↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31407)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31424): Process ended prematurely: osmo-stp_10.42.42.5(pid=31424) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31424)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31435): Process ended prematurely: osmo-stp_10.42.42.5(pid=31435) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31435)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31449): Process ended prematurely: osmo-stp_10.42.42.5(pid=31449) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31449)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31460): Process ended prematurely: osmo-stp_10.42.42.5(pid=31460) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31460)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31475): Process ended prematurely: osmo-stp_10.42.42.5(pid=31475) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31475)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31486): Process ended prematurely: osmo-stp_10.42.42.5(pid=31486) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31486)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31500): Process ended prematurely: osmo-stp_10.42.42.5(pid=31500) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31500)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31511): Process ended prematurely: osmo-stp_10.42.42.5(pid=31511) [trial-2373↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31511)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31525): Process ended prematurely: osmo-stp_10.42.42.5(pid=31525) [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31525)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31536): Process ended prematurely: osmo-stp_10.42.42.5(pid=31536) [trial-2373↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31536)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31550): Process ended prematurely: osmo-stp_10.42.42.5(pid=31550) [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31550)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31561): Process ended prematurely: osmo-stp_10.42.42.5(pid=31561) [trial-2373↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31561)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31575): Process ended prematurely: osmo-stp_10.42.42.5(pid=31575) [trial-2373↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31575)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31586): Process ended prematurely: osmo-stp_10.42.42.5(pid=31586) [trial-2373↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31586)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31606): Process ended prematurely: osmo-stp_10.42.42.5(pid=31606) [trial-2373↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31606)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=31618): Process ended prematurely: osmo-stp_10.42.42.5(pid=31618) [trial-2373↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31618)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=31636): Process ended prematurely: osmo-stp_10.42.42.5(pid=31636) [trial-2373↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31636)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31646): Process ended prematurely: osmo-stp_10.42.42.5(pid=31646) [trial-2373↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31646)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31657): Process ended prematurely: osmo-stp_10.42.42.5(pid=31657) [trial-2373↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31657)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31674): Process ended prematurely: osmo-stp_10.42.42.5(pid=31674) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31674)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=31686): Process ended prematurely: osmo-stp_10.42.42.5(pid=31686) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31686)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31706): Process ended prematurely: osmo-stp_10.42.42.5(pid=31706) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31706)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31716): Process ended prematurely: osmo-stp_10.42.42.5(pid=31716) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31726): Process ended prematurely: osmo-stp_10.42.42.5(pid=31726) [trial-2373↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31726)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=31743): Process ended prematurely: osmo-stp_10.42.42.5(pid=31743) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31743)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31755): Process ended prematurely: osmo-stp_10.42.42.5(pid=31755) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31755)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=31783): Process ended prematurely: osmo-stp_10.42.42.5(pid=31783) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31783)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32318): Process ended prematurely: osmo-stp_10.42.42.5(pid=32318) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32318)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32330): Process ended prematurely: osmo-stp_10.42.42.5(pid=32330) [trial-2373↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32330)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32348): Process ended prematurely: osmo-stp_10.42.42.5(pid=32348) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32348)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=32360): Process ended prematurely: osmo-stp_10.42.42.5(pid=32360) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32360)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=32378): Process ended prematurely: osmo-stp_10.42.42.5(pid=32378) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32378)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32388): Process ended prematurely: osmo-stp_10.42.42.5(pid=32388) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32388)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32398): Process ended prematurely: osmo-stp_10.42.42.5(pid=32398) [trial-2373↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32411): Process ended prematurely: osmo-stp_10.42.42.5(pid=32411) [trial-2373↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32411)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=32420): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32420) [trial-2373↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32420)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=32422): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32422) [trial-2373↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32422)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=32424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32424) [trial-2373↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32424)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=32426): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32426) [trial-2373↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32426)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.4 sec) Error: osmo-hlr_10.42.42.2(pid=32435): Process ended prematurely: osmo-hlr_10.42.42.2(pid=32435) [trial-2373↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32435)] FAIL: esme_connect_policy_closed.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=32446): Process ended prematurely: osmo-hlr_10.42.42.2(pid=32446) [trial-2373↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32446)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32458): Process ended prematurely: osmo-stp_10.42.42.5(pid=32458) [trial-2373↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32458)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32469): Process ended prematurely: osmo-stp_10.42.42.5(pid=32469) [trial-2373↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32469)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32484): Process ended prematurely: osmo-stp_10.42.42.5(pid=32484) [trial-2373↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32495): Process ended prematurely: osmo-stp_10.42.42.5(pid=32495) [trial-2373↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32506): Process ended prematurely: osmo-stp_10.42.42.5(pid=32506) [trial-2373↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32506)] FAIL: register_a5_3_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32517): Process ended prematurely: osmo-stp_10.42.42.5(pid=32517) [trial-2373↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32517)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.7 sec) Error: srsepc(pid=32539): Process ended prematurely: srsepc(pid=32539) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32539)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=32556): Process ended prematurely: srsepc(pid=32556) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32556)] FAIL: iperf3_dl.py (18.7 sec) Error: srsepc(pid=32572): Process ended prematurely: srsepc(pid=32572) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32572)] FAIL: iperf3_ul.py (18.6 sec) Error: srsepc(pid=32588): Process ended prematurely: srsepc(pid=32588) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32588)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=32604): Process ended prematurely: srsepc(pid=32604) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32604)] FAIL: rrc_idle_mo_ping.py (18.4 sec) Error: srsepc(pid=32623): Process ended prematurely: srsepc(pid=32623) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32623)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=32639): Process ended prematurely: srsepc(pid=32639) [trial-2373↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=32639)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=32654): Process ended prematurely: osmo-stp_10.42.42.5(pid=32654) [trial-2373↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32654)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32668): Process ended prematurely: osmo-stp_10.42.42.5(pid=32668) [trial-2373↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32668)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32682): Process ended prematurely: osmo-stp_10.42.42.5(pid=32682) [trial-2373↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32682)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32696): Process ended prematurely: osmo-stp_10.42.42.5(pid=32696) [trial-2373↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32696)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32711): Process ended prematurely: osmo-stp_10.42.42.5(pid=32711) [trial-2373↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32711)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32726): Process ended prematurely: osmo-stp_10.42.42.5(pid=32726) [trial-2373↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32726)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32740): Process ended prematurely: osmo-stp_10.42.42.5(pid=32740) [trial-2373↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32740)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32754): Process ended prematurely: osmo-stp_10.42.42.5(pid=32754) [trial-2373↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32754)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=300): Process ended prematurely: osmo-stp_10.42.42.5(pid=300) [trial-2373↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=300)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=314): Process ended prematurely: osmo-stp_10.42.42.5(pid=314) [trial-2373↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=314)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=329): Process ended prematurely: osmo-stp_10.42.42.5(pid=329) [trial-2373↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=329)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=343): Process ended prematurely: osmo-stp_10.42.42.5(pid=343) [trial-2373↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=343)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=370): Process ended prematurely: osmo-stp_10.42.42.5(pid=370) [trial-2373↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=370)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=384): Process ended prematurely: osmo-stp_10.42.42.5(pid=384) [trial-2373↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=384)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=398): Process ended prematurely: osmo-stp_10.42.42.5(pid=398) [trial-2373↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=398)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=684): Process ended prematurely: osmo-stp_10.42.42.5(pid=684) [trial-2373↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=684)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=698): Process ended prematurely: osmo-stp_10.42.42.5(pid=698) [trial-2373↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=698)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=712): Process ended prematurely: osmo-stp_10.42.42.5(pid=712) [trial-2373↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=712)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=727): Process ended prematurely: osmo-stp_10.42.42.5(pid=727) [trial-2373↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=727)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=741): Process ended prematurely: osmo-stp_10.42.42.5(pid=741) [trial-2373↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=741)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=755): Process ended prematurely: osmo-stp_10.42.42.5(pid=755) [trial-2373↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=755)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=769): Process ended prematurely: osmo-stp_10.42.42.5(pid=769) [trial-2373↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=769)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=783): Process ended prematurely: osmo-stp_10.42.42.5(pid=783) [trial-2373↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=783)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=797): Process ended prematurely: osmo-stp_10.42.42.5(pid=797) [trial-2373↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=797)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=815): Process ended prematurely: osmo-stp_10.42.42.5(pid=815) [trial-2373↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=815)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=834): Process ended prematurely: osmo-stp_10.42.42.5(pid=834) [trial-2373↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=834)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=849): Process ended prematurely: osmo-stp_10.42.42.5(pid=849) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=863): Process ended prematurely: osmo-stp_10.42.42.5(pid=863) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=863)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=891): Process ended prematurely: osmo-stp_10.42.42.5(pid=891) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=891)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=905): Process ended prematurely: osmo-stp_10.42.42.5(pid=905) [trial-2373↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=905)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=919): Process ended prematurely: osmo-stp_10.42.42.5(pid=919) [trial-2373↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=919)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=933): Process ended prematurely: osmo-stp_10.42.42.5(pid=933) [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=933)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=948): Process ended prematurely: osmo-stp_10.42.42.5(pid=948) [trial-2373↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=948)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=964): Process ended prematurely: osmo-stp_10.42.42.5(pid=964) [trial-2373↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=964)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=978): Process ended prematurely: osmo-stp_10.42.42.5(pid=978) [trial-2373↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=978)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=997): Process ended prematurely: osmo-stp_10.42.42.5(pid=997) [trial-2373↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=997)] + rm -rf trial-2373/inst + cd trial-2373 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 09:47:56 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373-run.tgz run.2022-12-10_09-48-07 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17660.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6681.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2956.tgz osmo-mgw.build-8947.tgz osmo-msc.build-29270.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30048.tgz osmo-stp.build-9242.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE